Actually, simply using a latching switch would do it. Also, there are such things as latching relays, so using the right switch would even allow for programmed operation, and would also provide the proper device for the job, particularly if power levels beyond simple logic circuits are needed to be controlled.