To Uninstall TestCaddy simply open the control panel and click "Add Remove Programs", locate TestCaddy and click the uninstall button.

This will not remove the .INI file or reg keys which can be manually removed by following the FAQ here.