If you have stale connections in UltraVNC viewer and want to delete them, you must edit the registry. Find the key:

\\HKEY_CURRENT_USER\Software\ORL\VNCviewer\MRU

You can then delete the keys under this hierarchy that you no longer need.