No need to feel guilty really, don't let old ideas of Catholic morality keep you from enjoying yourself, adn indulging in the most natural urge that we human beings have.
Unless you're so addicted to escorts that you're spending money that really ought to going somewhere else (mortgage, bills, kids, etc.), then you've got nothing to worry about! Just don't let it cut in to your other fiancial responsibilities/priorities, and it should be smooth, guilt-free punting for you!
Its better to regret something you have done than something you haven't. Plus once the cash is gone its gone. Forgetaboutit.