or 02-9262-7770 
ArticleLiveFastFind NX Progress Update
- By Rodney Amato
- Published 09/4/2007
FastFind NX is shaping up pretty well. I've spent the last few days working on the statistics and, for those of you who are familiar with the SendStudio or latest ActiveKB stats will already have an idea of what the Stats are going to look like. Here's a picture of the summary page.
If you look carefully you will see that the installation of FastFind that I took the screenshot of has almost 20,000 pages indexed. Something I wouldn't have wanted to try with the old version.
We did a quick benchmark to try and put a figure as to how much faster (or slower) the new version is. As you can see from the graphs below, the new version is going to blow the old FastFind out of the water.
Crawling the 1000 pages (without having crawled any of them before) took just under 5 minutes with the old version and only 27 seconds with the new version, making it almost 5 times as fast for this test. The area where FastFind NX is really going to benefit it's users is in re-crawling a site since it can skip the most intensive database queries if the page (or file) hasn't changed on the server, making it not only much faster, but less of a strain on the server doing the crawl.
The other big thing I did this afternoon was to whip up a few additional parsers. Originally I had planned on only shipping the beta with 3 parsers, the default parser (which handled html), the PHP version of the PDF and the EXIF parser. This afternoon I created 3 more parsers which will let you parse PDF files using the free program pdftohtml, MS Word doc files using the free program antiword and MS Powerpoint files using the free program ppthtml. In fact making these were so easy that I'm considering adding more before the final version is released.
There isn't much left to do before the beta version so I will start taking applications for beta testers. If you would like to test FastFind NX and are an exisiting FastFind customer, just email me at rodney at interspire dot com.
If you look carefully you will see that the installation of FastFind that I took the screenshot of has almost 20,000 pages indexed. Something I wouldn't have wanted to try with the old version.
We did a quick benchmark to try and put a figure as to how much faster (or slower) the new version is. As you can see from the graphs below, the new version is going to blow the old FastFind out of the water.
Crawling the 1000 pages (without having crawled any of them before) took just under 5 minutes with the old version and only 27 seconds with the new version, making it almost 5 times as fast for this test. The area where FastFind NX is really going to benefit it's users is in re-crawling a site since it can skip the most intensive database queries if the page (or file) hasn't changed on the server, making it not only much faster, but less of a strain on the server doing the crawl.
The other big thing I did this afternoon was to whip up a few additional parsers. Originally I had planned on only shipping the beta with 3 parsers, the default parser (which handled html), the PHP version of the PDF and the EXIF parser. This afternoon I created 3 more parsers which will let you parse PDF files using the free program pdftohtml, MS Word doc files using the free program antiword and MS Powerpoint files using the free program ppthtml. In fact making these were so easy that I'm considering adding more before the final version is released.
There isn't much left to do before the beta version so I will start taking applications for beta testers. If you would like to test FastFind NX and are an exisiting FastFind customer, just email me at rodney at interspire dot com.
Author/Admin)
