Reality is it's never safe even if the escort is independent. A neighbor can easily see men coming and going throughout the day, and sounds will make it obvious.
If there's drunks and creeps showing up at night it won't be long before the neighbours make a complaint to the guards.