I refuse to believe that a power supply can 'know' how to develop a 'virtual ground' regardless of which way around the mains are connected. There must be some physical connection between mains ground and circuit common for this to happen as you describe.
I would suggest that you measure the resistance between the two 'grounds' with a fully isolated meter, and disconnect each other peripheral one by one. At some point the 'ground' connection must disappear.