SharePoint 2010 Ribbon Feature (bug?)

I am testing some of the new parts of SharePoint 2010 for an upcoming project at work, and while creating a new Ribbon tab I ran into some problems. The tab is defined in a CustomAction that is deployed as a feature. While playing around with different setups I started to encounter errors that I simply could not fix even when I undid everything and used a version I knew had worked. After spending way to much time on this issue this happened:

I changed the Tab title from “The Tab” to “Another Tab”, when deployed everything seemed fine:

But when I clicked on the tab the title changed back to the old title

Well that made no sense what so ever, so I started to test a bit and it seems SharePoint keeps a copy of the feature even when the feature and solution it came in is removed. The funny part is that it is only some parts of the “old feature copy” that SharePoint remembers.
So how to overcome this issue? I started to Google and it seems I am not the only one with this problem, some suggested to recreate the VS solution every time you change something in the Ribbon with comments like “You only have one shot at this, be sure to get it right the first time”. I found that the easiest way to make sure changes made to the Ribbon actually gets deployed is to change the Feature Id, this can be done in VS2010 in the feature properties:

So I am left with a workaround but no idea as to why SharePoint keeps parts of old features and no idea if this is working as intended? I do not recall having this problem in MOSS2007..
I will try and dig a little deeper into this and update this post if I find anything worth mentioning.