The legitimacy thing works both ways. As a customer you lose plausible deniability if there's no doubt about what a shop offers. I already stick to shops with discrete entrances.
No way do I want to be seen going to a legal sex shop, the legality isn't what would cause issues for me at work or at home