Just for the curious ones :
(note this doesn't qualify as audiophile)
Last year I was offered an old 3way speaker (the other one was broken) and decided that it would be nice for my PC (I have a cheap boombox connected to the output of my integrated soundcard).
Initially, i connected it to the output of the boombox (speakers are detachable) but that wasn't much good.
Then, i remembered i had a car amplifier (old and cheap one too), of those small ones, which curiously, fits exactly in a 5 1/4'' bay in my PC!

Connected it to the power supply ( yellow cable ), the input to one of the outputs of the mixer table (to give some preamp), and the output to the speaker.
I don't have much volume, but the bass has improved considerably

From this, I take that indeed, a PC power supply would suffice for the thing (and they are cheap, ~20€ )
Of course, you can always use a Battery charger too, but those tend to offer low Amperage. Still, i used one once for a car radio too, with some small speakers.