I know there is a way to set widths for your table cells, but is there a way to set the height for a certain cell?

What exactly do you mean? It would be easier if we could see your page. It should be just like the width, put <height="blah blah"> in the TD tag. o_O

style="height: XXXpx;"
set the number in there for XXX.

or if you prefer the old way...
height="XXX"