Lol, it hasn't happened to me yet but yes sometimes it can be confusing especially while traveling. Its also confusing in the malls with regards to fitting rooms. I have heard that some prefer the men's fitting rooms because there is usually less of a rush/line...especially during the holiday season.

Thanks :)