Nah, 3G/4G dongles are only as expensive as you want to make them.
A quick web search shows that they are available from eBay and Amazon. The magic search term is "3G 4G dongle", which gets you links to 3G/4G devices that look very similar to USB memory sticks.
Typically they use both 2.4 and 5 GHz bands and some also support Bluetooth connectivity. Prices seem to range from around GBP 13.00 upwards to *HOW MUCH???*. They do purely data comms, of course, and would seem provide much the same connectivity as any mains-powered wifi router except for being smaller, lighter, powered from whatever its plugged into and (quite probably) only provides a single connection to the network.
IOW it does about the same job as the wifi link on a Pi 3, 4 or Zero W except that it preferentially connects to a 3G or 4G base station rather than to the nearest wifi router.