If they were volunteers then I wouldn't be too harsh with them. Firm, but not harsh. Most of the ones collecting money outside churches, supermarkets etc are volunteers that give up free-time without any pay to do what can be a hard job. Never heard about them going door-to-door before. Might it have been a scam? Did you ask for ID?

The ones that p*ss me off are the on-commission pains in the ass chuggers that harrass you as you are walking down the street. The ones who want to shake your hand and pretend to be your best friend. Hypocritical F***ers. It should be perfectly legal to punch them in the head if they block your way.