They go to the framebuffer console X is started from (Ctrl-Alt-F1), unless they were started from a terminal window. But those messages aren't sent to syslog by the GUI applications, maybe your systems have something extra which does that when GUI programs are started?
Syslog messages go nowhere if there's no syslog daemon running.