I got the fan off, with some wriggling from a flat screwdriver. The shaft with the electro parts on it came out. There appears to be a race for the bearings on one end of the shaft, the end with the metal fan, and the race spins freely on the shaft. The other side of the shaft, which had the white plastic fan, looks pretty loose, and the only force holding the shaft in place there seems to be 2 springloaded opposing metal posts which push in on either side of the shaft as it spins between them, on grooves in the shaft. Maybe there were ball bearings in those grooves?
I did find a broken washer on the outside of the shaft, near the loosened nut.
Maybe a race got sucked up into the bag at some point?
Still scratching the head.