IFTS Master merge keep failing

Question

Hi,
I'm using IFTS of sql server 2008.
I'm indexing html documents comperssed with Zip Ifilter (of IFilter Shop).
And I have several issues, I currently can't resolve.
Currently the catalog has about 500,000 documents, the popultaion takes sevral hours (between 5-10), when the fdhost at start (about first 300,000) documents is on 15-70% CPU usage and after that it's on 0%, and the remaining rebuold process takes a lot of time.
The second issue is that the ctalog is very defragmented sys.fulltext_index_fragments returns about 250 fragments.
When I try to reorganize I receive the following error:
Msg 30031, Level 17, State 100, Line 1
A full-text master merge failed on full-text catalog 'ContentCatalog' in database 'NogaClass' with error 0x80FC755D.

I tried to delete the full-text index and to rebuild it and then reorganize, but it didn't help.

Can anyone please advice?

P.S. The defragmentation causes a very slow search performance.

Answer 1

are there any messages in the ftp logs?

---

looking for a book on SQL Server replication? http://www.nwsu.com/0974973602.html looking for a book on SQL Server 2008 Administration? http://www.amazon.com/Microsoft-Server-2008-Management-Administration/dp/067233044X looking for a book on SQL Server 2008 Full-Text Search? http://www.amazon.com/Pro-Full-Text-Search-Server-2008/dp/1430215941

Answer 2

Yes,
I forgot to mantion.
Sometimes it throws the following message: "Fulltext index error during compression or decompression. Full-text index may be corrupted on disk. Run dbcc checkdatabase and re-populate the index."
It happened on several machines. I've moved around the filegroups to different disks, but it keeps happening.
BTW. When the master merge failing, no special message is written to the log.

Thanks, Marina

 

Answer 3

can you backup this db and restore it on a different machine and try it there?

What document types are you indexing?

---

looking for a book on SQL Server replication? http://www.nwsu.com/0974973602.html looking for a book on SQL Server 2008 Administration? http://www.amazon.com/Microsoft-Server-2008-Management-Administration/dp/067233044X looking for a book on SQL Server 2008 Full-Text Search? http://www.amazon.com/Pro-Full-Text-Search-Server-2008/dp/1430215941

Answer 4

The same installation is running on 3 different machines. This happens on all of them.
I'm indexing zipped html files and using Zip Ifilter.

Any ideas?
Thanks, Marina

Answer 5

Sounds like a problem with the ifilter.

---

looking for a book on SQL Server replication? http://www.nwsu.com/0974973602.html looking for a book on SQL Server 2008 Administration? http://www.amazon.com/Microsoft-Server-2008-Management-Administration/dp/067233044X looking for a book on SQL Server 2008 Full-Text Search? http://www.amazon.com/Pro-Full-Text-Search-Server-2008/dp/1430215941

Answer 6

I'm trying to use Microsoft Filter Pack for the zip filter (as suggested in "Pro Full-Text Search in SQL Server 2008" book).

But it doesn't seem to work.

Am I doing something wrong, or it shouldn't work?

Thanks a lot, Marina

Answer 7

it should work. How many html files per zip?

---

looking for a book on SQL Server replication? http://www.nwsu.com/0974973602.html looking for a book on SQL Server 2008 Administration? http://www.amazon.com/Microsoft-Server-2008-Management-Administration/dp/067233044X looking for a book on SQL Server 2008 Full-Text Search? http://www.amazon.com/Pro-Full-Text-Search-Server-2008/dp/1430215941

Answer 8

Just one.

Answer 9

Hi,

I succeeded to configure the Microsoft Filter Pack and ran it on a 64 bit machine.

Unfortunately, the same problem happens here too.

(2009-10-22 03:44:05.93 spid20s     Error: 30045, Severity: 17, State: 80.

2009-10-22 03:44:05.93 spid20s     Fulltext index error during compression or decompression. Full-text index may be corrupted on disk. Run dbcc checkdatabase and re-populate the index.

)

So I'm guessing, that it's not the filter's problem.

Can anyone point me to a right direction?

Thanks, Marina