If the 2-3 girls are working together at the same time, you should remember that there will be 2-3 times more guys turning up, therefore that will draw attention to the property. However, if only 1 girl works there at a time, it will be a bit more discreet as it can be, you having mentioned that it's not in a complex, if you visit then you will have to accept that a fellow punter may see you entering/leaving the premises.
If you feel so uncomfortable punting in that town, travel to another near-by town & punt there.
Sandy x