yesterday evening, we upgraded our TFS Server with the Conchango Scrum template 2.2.  For testing we created a testproject.  Afterwards when we want to delete the project we got following error:

TF30063: You are not authorized to access <tfsserver>

As I'm in the TFS Admin group I thought this would be no problem.  But it is.  And the problem is at the level of the Sharepoint Project Portal.  I was not defined in site collection administration.  It seems that the Farm admins supports AD groups, while the Site collection administrators doesn't.

So the solution is easy.

1. Go to the team project portal
2. Click on site actions and choose Site settings
3. Click on Site collection administrators
4. Add your account

Now, you can delete your project.

If you want to know more, read more on this technet article.