Good practics is to put the bypass caps as close to the IC leads as is practical, and run short traces (or wires) to the IC pins.
I wasn't suggesting one bypass cap from V+ to ground and another from V- to ground... since you're using a single-sided supply and V- is DC ground, that would be redundant (as you have noted).