There is a tool called a door pin remover that us panelbeaters use ,
there are also the occasions where others who try tend to make it harder to remove after they are butchered,
there is also a freeze shrinking spray available however I have not used it before,
I know the spray can be bought from wurth australia and the door pin remover from a automotive tool supply shop