How do you make it so that when you hover above a button, it changes to another image?

You can do it using a javascript or by making a rollover image on Paint Shop.

Here's where you can learn to do it using a javascript:

http://www.lissaexplains.com/java3.shtml#images