the ones where you hover your mouse over and they appear with some text inside, they're usually pale yellow, does anyone know how to make those? thanks.

it's the 'alt' attribute that does it :).
<img src="imagefile" width="25" height="25" alt="bubbletext">

thanks!

For text links it works like this:

<a href="address" title="your text goes here">TEXT</a>