VSIX uninstall - Remove Icons

Question

Hi,

    I am using VS 2010 to develop my application. We have a package which outputs a .VSIX file. When we double click this file and install it, The package's icon appears in the toolbar. But after I uninstall the icon still stays in the Toolbox.

My specific ques: How can we remove it automatically when uninstalling? Is there a setting I am missing or Do I need to code somewhere.

Thanks!