Hahahaha try sunny men's in North Sydney. It's in an office block or at least was the last time I went.
Sussex star (right next to darling park) has a back entrance in James lane. Should probably call the shop as you're approaching as the door is sometime locked. You might get seen by some smokers in the loading dock but oh well.
There's also this one in the basement of the breakfree apartments on Sussex and George (somewhat close to the ANZ).