Is there a way to clear the registry entries or trigger some custom logic when a VSIX package (your package that you coded, not just arbitrary) is removed from Visual Studio?
AFAIK you will need MSI based installation for custom actions