The jitter that matters is what comes out of the VCXO. That is determined by the VCXO's open-loop jitter spectrum, reduced by the feedback loop at lower frequencies. There's an analog lowpass filter in the feedback loop whose unity-gain bandwidth will be roughly 500 Hz. Picosecond jitter in the phase detector path will not make it through that lowpass filter. What does get through the filter is the statistical 1/0 decisions of the PD flipflop, which, barring math tricks, get made at 80 KHz.
As the XO gets more expensive, the lowpass filter cutoff frequency can be reduced. That tradeoff is the original subject of the thread.
"Jitter filter" aka "clock cleanup" is a common concept. I expect the
155.52 clock to have a lot less time jitter than the 10 MHz reference. A few ps jitter around the phase detector flop won't matter.Jitter at the PD flop essentially reduces the gain (measured in volts/ps) of the phase detector.