Comments on: Crawling http://www.shiffman.net Mon, 08 Mar 2010 22:22:09 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: Prashant http://www.shiffman.net/teaching/a2z/crawling/comment-page-1/#comment-16702 Prashant Mon, 12 Mar 2007 00:00:35 +0000 http://www.shiffman.net/teaching/programming-from-a-to-z/crawling/#comment-16702 Hi, I went through your website, interesting stuff using websphinx. I would appreciate if u could help me. I am doing a project of mine at LSE, where in I am trying to using websphinx for pattern matching in the database. Can u help to understand how to implement the websphinx pattern matching capability for DB. Thanks in advance Rg, Prashant Hi,

I went through your website, interesting stuff using websphinx. I would appreciate if u could help me. I am doing a project of mine at LSE, where in I am trying to using websphinx for pattern matching in the database. Can u help to understand how to implement the websphinx pattern matching capability for DB.

Thanks in advance
Rg,
Prashant

]]> By: Marius Watz http://www.shiffman.net/teaching/a2z/crawling/comment-page-1/#comment-130 Marius Watz Tue, 28 Mar 2006 21:40:34 +0000 http://www.shiffman.net/teaching/programming-from-a-to-z/crawling/#comment-130 You can use the Norbert library to check robots.txt for permissions, it's Open Source and easy to implement. See <a href="http://www.osjava.org/norbert/HowTo.html" rel="nofollow">http://www.osjava.org/norbert/HowTo.html</a> You can use the Norbert library to check robots.txt for permissions, it’s Open Source and easy to implement. See http://www.osjava.org/norbert/HowTo.html

]]>