a. You can just add the title attribute in td element. Then when you hover over the table cell you will have a tooltip.
<td title='I am a tooltip'> My Text</td>
More info: http://www.w3schools.com/tags/att_global_title.asp
b. No you don't need to setup a web server