TFS Backup tool fails - When it starts taking transactional backup...

Question

 

Hi,

Need help to get rid of this issue.....

I have scheduled TFS backup using TFS power tool. It was working fine till 10 days back. Now it started this.....tried all the ways what am aware of but no luck. Am a newbie to this...please help....

 

 

Answer 1

It's hard to say exactly what's going wrong since we aren't seeing the Sql Server error messages.

However ... to venture a guess based on the fact that it was working and now isn't ... have you checked the available disk space for the backups?

---

DevBiker (aka J Sawyer)
My Blog
My Bike - Concours 14

---

If I answered your question, please mark as answer.
If my post was helpful, please mark as helpful.

Answer 2

 

Hi Dev,

Thank you for your reply.....!

More than 500GB free space is available in the backup drive.....I suspect something else.....but don't how to resolve.....

Regards

Vasu Kodidela

---

Vasuki Chowdary

Answer 3

Hi Vasu,

Thank you for your post.

According to your description of the issue, here are some situations i want to clarify from you:
1. What's the version of TFS and SQL?
2. Could you post the detail log relate to this issue?

In addition, take the following steps for a try:
1. Open SQL Server Management Studio
2. Connect to the required instance of SQL server: "XXX\SqlExpress"
3. Right-click on the server instace-->Properties-->Connections-->Allow remote connections to this server, change the remote query timeout limit from 600 Seconds to your required limit, you can make it double.

I hope this information will help resolve this issue.
 
If anything is unclear, please free feel to let me know.

Best Regards,

---

Lily Wu [MSFT]
MSDN Community Support | Feedback to us

Answer 4

 

Hi Lily,

I tried this but no luck.

Am using SQL Server 2008 R2 and TFS 2010. These two are installed on seperate machines.

Regards

Vasu  Kodidela

 

---

Vasuki Chowdary

Answer 5

Hi Vasu,

1. Can you back up databases through SQL Server Management Studio? For the detail step you can refer to How to: Back Up a Database (SQL Server Management Studio)

2. Would you please open Event Viewer and check to see if there is any message at the time the back up happened? Or other detail log relate to this issue, it will help narrow down the issue.

If anything is unclear, please free feel to let me know.

Best Regards,

---

Lily Wu [MSFT]
MSDN Community Support | Feedback to us

Answer 6

Hi Lily,

The scenario is.....I have two boxes...

One is installed with windows 2008 & SQL Server 2008 R2 and the second box is with win7, TFS 2010 and Visual Studio 2010.

In the TFS box I have installed TFS power backup tool and scheduled backups.....it was working fine till last week.....now all of a sudden it started acting like this.....

I have not installed any SQL Server or SQL Server Express Edition in TFS box. (SQL Express 2008 components were installed while installing Visual Studio 2010)

Some of the .mdf and .ldf files in "C:\Program Files\Microsoft SQL Server\MSSQL10.SQLEXPRESS\MSSQL\DATA" location are more than 4GB....For more information please look at the attachments.

 

 

Please help to get rid of this issue.

Regards

---

Vasuki Chowdary

How to do the below procedure....

{As Sanjay said in the below link....

http://social.msdn.microsoft.com/Forums/en-IN/tfspowertools/thread/899f90e6-892f-4df9-9cd8-f19856cb684b

One more thing to check is make sure your database log files are small, which will help you in fast backups and restore.

in SQL server 2005, we can truncate logs, but in SQL server 2008, if we are using full recovery mode, the logs will not be deleted from the disk, even if they are non-active transactional logs (like after full backup of Transactional logs with truncate logs option in SQL Server 2008).

the workaround to this problem is

once in a month, with the help of a script, I am changing all the databases to simple recovery mode, then shrink the log files and then change back those Databases to Full recovery mode. the whole process takes around 30 seconds.

the above solution reduce my transactional logs from 10GB to 10MB in total

and reduce backup time from 12 minutes to 3 minutes for all the databases.

if you need more help or need scripts let me know - Cheers!

Sanjay

[e-mail]}

Answer 7

Hi Vasu,

 

Thank you for your question.

 

I am trying to involve someone familiar with this topic to further look at this issue. There might be some time delay. Appreciate your patience.

 

Thank you for your understanding and support.

 

Best Regards,

---

Lily Wu [MSFT]
MSDN Community Support | Feedback to us

Answer 8

Please create a new backup plan and see if the same problem happens. If it does, please:

• Provide the detailed error log. You can get this using the link on the error page which reads "To view the detailed log, click here"
• Provide the SQL error log
• There is an XML file at one folder level above the logfiles folder. Open this with Notepad and take a look to see if the configuration there is correct.

---

Trevor Hancock (Microsoft)
Please remember to "Mark As Answer" the replies that help.

Answer 9

Thank you Lily. But help me please.

---

Vasuki Chowdary

Answer 10

Hi Trevor,

I tried but no luck.

Regards

---

Vasuki Chowdary

Answer 11

Can you please provide the SQL error log?

---

Trevor Hancock (Microsoft)
Please remember to "Mark As Answer" the replies that help.

Answer 12

Hi Trevor,

Please find the SQL Log below.
========================================================================================================

[Info   @09:24:46.135] GetToolsPath D:\Program Files\Microsoft Team Foundation Server 2010\Tools\
[Info   @09:26:02.339] 
[Info   @09:26:02.339] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.339] Running Readiness Checks ...
[Info   @09:26:02.339] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.339] 
[Info   @09:26:02.339] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.339] Activity.Verify
[Info   @09:26:02.339] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.339] Verify: Root(VCONTAINER): Starting Verification
[Info   @09:26:02.339] A generic container node that does not contribute to results
[Info   @09:26:02.339] "Verify: Root(VCONTAINER): Exiting Verification with state Ignore and result Ignore"
[Info   @09:26:02.339] Verify: Root\OnePlanPerConfiguration(OnePlanPerConfiguration): Starting Verification
[Info   @09:26:02.339] One Plan Per Configuration
[Info   @09:26:02.354] "Verify: Root\OnePlanPerConfiguration(OnePlanPerConfiguration): Exiting Verification with state Completed and result Success"
[Info   @09:26:02.354] Verify: Root\VerifySuccessfullCollectionDataBasesInspection(DatabaseAccess): Starting Verification
[Info   @09:26:02.354] Verify successfull database inspection.
[Info   @09:26:02.386] Found collection database CoromandelApp Collection
[Info   @09:26:02.386] Found collection database TenXLabsHRMS
[Info   @09:26:02.386] Found collection database PayGenieDelphi
[Info   @09:26:02.386] Found collection database Customization
[Info   @09:26:02.386] Found collection database TenxContext Collection
[Info   @09:26:02.386] Found collection database DefaultCollection
[Info   @09:26:02.386] "Verify: Root\VerifySuccessfullCollectionDataBasesInspection(DatabaseAccess): Exiting Verification with state Completed and result Success"
[Info   @09:26:02.386] Verify: Root\VerifyBackupOperation(VerifyPermissionsOnBackupPath): Starting Verification
[Info   @09:26:02.386] Verify Permissions on Backup Path
[Info   @09:26:02.510] Adding machine account TENX\TENX-PC6$ for SQL services on server tenx-pc6\sqlexpress
[Warning@09:26:02.620] !Verify Warning!: MSSQL Server service account TENX\TENX-PC6$ does not have the required permissions to create backups on the backup path \\DC\BackupForTFS\TFS_RepoBase
[Info   @09:26:02.620] "Verify: Root\VerifyBackupOperation(VerifyPermissionsOnBackupPath): Exiting Verification with state Completed and result Warning"
[Info   @09:26:02.620] Verify: Root\VerifyDiskFreeSpace(DiskFreeSpace): Starting Verification
[Info   @09:26:02.620] Verifies that the backup path have free space
[Info   @09:26:02.620] freeBytesForUser 477376016384
[Info   @09:26:02.620] totalBytes 1000202240000
[Info   @09:26:02.620] freeBytes 477376016384
[Info   @09:26:02.620] "Verify: Root\VerifyDiskFreeSpace(DiskFreeSpace): Exiting Verification with state Completed and result Success"
[Info   @09:26:02.620] !Verify Result!: 4 Completed, 0 Skipped: 3 Success, 0 Errors, 1 Warnings
[Info   @09:26:02.620] 
[Info   @09:26:02.620] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.620] Executing ...
[Info   @09:26:02.620] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.620] Starting Node: InspectDatabases
[Info   @09:26:02.620] Inspect Databases
[Info   @09:26:02.635] 
[Info   @09:26:02.635] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.635] Inspecting Databases in the system...
[Info   @09:26:02.635] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.635] Found configuration db Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_Configuration;Integrated Security=True
[Info   @09:26:02.635] Inspecting collection databases...
[Info   @09:26:02.651] Found collection Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_CoromandelApp Collection";Integrated Security=True
[Info   @09:26:02.651] Found collection Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_TenXLabsHRMS;Integrated Security=True
[Info   @09:26:02.666] Found collection Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_PayGenieDelphi;Integrated Security=True
[Info   @09:26:02.666] Found collection Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_Customization;Integrated Security=True
[Info   @09:26:02.666] Found collection Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_TenxContext Collection";Integrated Security=True
[Info   @09:26:02.666] Found collection Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_DefaultCollection;Integrated Security=True
[Info   @09:26:02.666] Inspecting reporting components...
[Info   @09:26:02.682] Reporting is not configured
[Info   @09:26:02.682] Done.
[Info   @09:26:02.682] InspectDatabases Completed.
[Info   @09:26:02.682] Starting Node: PrepareDatabases
[Info   @09:26:02.682] Prepare Databases For Taking Synchronized Backups
[Info   @09:26:02.698] 
[Info   @09:26:02.698] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.698] Preparing databases for taking synchronized backups
[Info   @09:26:02.698] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.698] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_CoromandelApp Collection";Integrated Security=True
[Info   @09:26:02.698] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_TenXLabsHRMS;Integrated Security=True
[Info   @09:26:02.698] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_PayGenieDelphi;Integrated Security=True
[Info   @09:26:02.698] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_Customization;Integrated Security=True
[Info   @09:26:02.698] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_TenxContext Collection";Integrated Security=True
[Info   @09:26:02.698] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_DefaultCollection;Integrated Security=True
[Info   @09:26:02.698] Stamping config db with backup plan key
[Info   @09:26:02.698] ALTER DATABASE [Tfs_Configuration] SET RECOVERY FULL
[Info   @09:26:02.699] Successfully prepared database Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_Configuration;Integrated Security=True
[Info   @09:26:02.699] ALTER DATABASE [Tfs_CoromandelApp Collection] SET RECOVERY FULL
[Info   @09:26:02.712] Successfully prepared database Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_CoromandelApp Collection";Integrated Security=True
[Info   @09:26:02.712] ALTER DATABASE [Tfs_TenXLabsHRMS] SET RECOVERY FULL
[Info   @09:26:02.726] Successfully prepared database Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_TenXLabsHRMS;Integrated Security=True
[Info   @09:26:02.726] ALTER DATABASE [Tfs_PayGenieDelphi] SET RECOVERY FULL
[Info   @09:26:02.752] Successfully prepared database Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_PayGenieDelphi;Integrated Security=True
[Info   @09:26:02.752] ALTER DATABASE [Tfs_Customization] SET RECOVERY FULL
[Info   @09:26:02.767] Successfully prepared database Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_Customization;Integrated Security=True
[Info   @09:26:02.767] ALTER DATABASE [Tfs_TenxContext Collection] SET RECOVERY FULL
[Info   @09:26:02.781] Successfully prepared database Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_TenxContext Collection";Integrated Security=True
[Info   @09:26:02.781] ALTER DATABASE [Tfs_DefaultCollection] SET RECOVERY FULL
[Info   @09:26:02.796] Successfully prepared database Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_DefaultCollection;Integrated Security=True
[Info   @09:26:02.796] Done.
[Info   @09:26:02.796] PrepareDatabases Completed.
[Info   @09:26:02.796] Starting Node: TakeFullBackup
[Info   @09:26:02.796] Take Full Backup of Databases
[Info   @09:26:02.799] 
[Info   @09:26:02.799] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.799] Waiting for any backup tasks running...
[Info   @09:26:02.799] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.804] 
[Info   @09:26:02.804] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.804] Taking full backup...
[Info   @09:26:02.804] -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
[Info   @09:26:02.806] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_CoromandelApp Collection";Integrated Security=True
[Info   @09:26:02.806] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_TenXLabsHRMS;Integrated Security=True
[Info   @09:26:02.806] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_PayGenieDelphi;Integrated Security=True
[Info   @09:26:02.806] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_Customization;Integrated Security=True
[Info   @09:26:02.806] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog="Tfs_TenxContext Collection";Integrated Security=True
[Info   @09:26:02.806] Addin Data Source=TenX-PC6\SqlExpress;Initial Catalog=Tfs_DefaultCollection;Integrated Security=True
[Info   @09:26:02.806] Taking full backup of database Tfs_Configuration
[Info   @09:26:18.605] Completed Backup For Database Tfs_Configuration
[Info   @09:26:18.605] Disk \\DC\BackupForTFS\TFS_RepoBase\Tfs_Configuration_20120204145602F.bak
[Info   @09:26:18.605] Retention Days 60
[Info   @09:26:18.605] Backup Set Name Tfs_Configuration database Backup
[Info   @09:26:18.605] Backup Set Description Tfs_Configuration database - Full Backup
[Info   @09:26:18.605] Adding database Tfs_Configuration to the backupset
[Info   @09:26:18.605] Taking full backup of database Tfs_CoromandelApp Collection
[Error  @09:36:18.705] Microsoft.SqlServer.Management.Smo.FailedOperationException: Backup failed for Server 'TenX-PC6\SqlExpress'.  ---> Microsoft.SqlServer.Management.Common.ExecutionFailureException: An exception occurred while executing a Transact-SQL statement or batch. ---> System.Data.SqlClient.SqlException: Timeout expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.
   at Microsoft.SqlServer.Management.Common.ConnectionManager.ExecuteTSql(ExecuteTSqlAction action, Object execObject, DataSet fillDataSet, Boolean catchException)
   at Microsoft.SqlServer.Management.Common.ServerConnection.ExecuteNonQuery(String sqlCommand, ExecutionTypes executionType)
   --- End of inner exception stack trace ---
   at Microsoft.SqlServer.Management.Common.ServerConnection.ExecuteNonQuery(String sqlCommand, ExecutionTypes executionType)
   at Microsoft.SqlServer.Management.Common.ServerConnection.ExecuteNonQuery(StringCollection sqlCommands, ExecutionTypes executionType)
   at Microsoft.SqlServer.Management.Smo.ExecutionManager.ExecuteNonQuery(StringCollection queries)
   at Microsoft.SqlServer.Management.Smo.ExecutionManager.ExecuteNonQueryWithMessage(StringCollection queries, ServerMessageEventHandler dbccMessageHandler, Boolean errorsAsMessages)
   at Microsoft.SqlServer.Management.Smo.BackupRestoreBase.ExecuteSql(Server server, StringCollection queries)
   at Microsoft.SqlServer.Management.Smo.Backup.SqlBackup(Server srv)
   --- End of inner exception stack trace ---
   at Microsoft.SqlServer.Management.Smo.Backup.SqlBackup(Server srv)
   at Microsoft.TeamFoundation.PowerTools.Admin.Helpers.BackupFactory.BackupFullsUsingSMO(String serverName, String databaseName, String fullFileName, Int32 retentionDays)
   at Microsoft.TeamFoundation.PowerTools.Admin.Helpers.BackupFactory.BackupUsingSMO(BackupSetType backupType, String serverName, String databaseName, String fileName, Int32 retentionDays)
   at Microsoft.TeamFoundation.PowerTools.Admin.Apply.TakeFullBackup.Run()
[Error  @09:36:18.706] Failed taking full backup.
[Error  @09:36:18.706] Backup failed for Server 'TenX-PC6\SqlExpress'. 
[Error  @09:36:18.712] !NODE Error!: 
[Error  @09:36:18.714] Backup failed for Server 'TenX-PC6\SqlExpress'. 
[Error  @09:36:18.717] Backup failed for Server 'TenX-PC6\SqlExpress'. 
[Error  @09:36:18.721] 
Exception Message: Backup failed for Server 'TenX-PC6\SqlExpress'.  (type ConfigurationException)


Exception Stack Trace:    at Microsoft.TeamFoundation.Admin.AdministrationEngine.NotifyResults(AdministrationNode node)
   at Microsoft.TeamFoundation.Admin.AdministrationEngine.RunNode(AdministrationNode node)
   at Microsoft.TeamFoundation.Admin.AdministrationEngine.RunNodes(AdministrationNode[] nodes)
   at Microsoft.TeamFoundation.Admin.AdministrationEngine.RunNodes(AdministrationNode rootNode)
   at Microsoft.TeamFoundation.Admin.Activity.Configure()
   at Microsoft.TeamFoundation.PowerTools.Admin.Activities.ActivityManager.ActivityWorker(Object sender, DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.OnDoWork(DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.WorkerThreadStart(Object argument)

Regards

---

Vasuki Chowdary

Answer 13

Could you try to backup directly from SQL Management Studio (right click on Database and make backup) and see if that fails.  If it does fail and there is no good error message, try running SQL profiler at the same time.  If this does not lead to a resolution, you will have to open a case with us as this will take some time to review.

---

Trevor Hancock (Microsoft)
Please remember to "Mark As Answer" the replies that help.