You won't get good EMI rejection on twisted pair unless both the driver and the receiver are balanced.
If you drive one and ground the other, the fields in the neighbourhood of the cable are approximately half differential and half common mode. That's because
V_CM = (V+ + V-)/2 and V_DIFF = (V+ - V-)/2.
If you drive V+ and ground V-,
V_CM = V_DIFF = V+ /2.
In other words, you've put half your signal swing in the differential (transmission line) mode, and half in the common (i.e. antenna) mode.
Antennas work both ways, so if you set it up to radiate like that, you're also setting it up to receive whatever's around.
Cheers
Phil Hobbs