Labels.
There is nothing wrong with labels, it's what defines us.
To use the example Gay. What's so wrong with being called gay, if indeed you like men or like TS's girls. Traditional being called Gay, was an insult, or it was in my school days. Now in this day and age it's just as accepted as being straight, and it's great to see the gay community celebrating it.
Why is that guys that see TS girls get so outrages when they are labeled gay or bi?? Perhaps its because that are ashamed of their feeling and they still consider, Gays and Bisexuals as second class citizens. In which case they are just as bigoted as the people that protest against the LGBT community, to add to the fact they are hypocrites.
It's being said already, what ever label you are, embrace it and enjoy life.
To answer the original OP question, "If a man is attracted to TS does that make him gay/Bi" probably not but it does make him gay/bi curious in my opinion. And what's the harm in that?
“Be yourself; everyone else is already taken.” - Oscar Wilde