My "go-to" parts bin always has some Simple Switchers (LM2575, etc..) These come in fixed or adjustable voltage varieties (programmed with resistors) A Diode assortment (they are cheap!), maybe including a bridge or two. Whatever my flavor of the month FET happens to be (right now it's IRFP4668).
And an assortment of 8051 flavor microcontrollers, especially including the AT89LP51ED2 -- which is a pretty handy little chip, even if from a family that's a little long in the tooth. :)
A 16x2 backlit character LCD display (cheap on Amazon)
Some opto-isolators, and some comparators or op-amps too.
You don't need to buy the farm. Mouser and Digikey are only keystrokes away.
Get a decent soldering station, though. And work lights.