Web Crawling with Perl

By Siddhartha Reddy | June 9, 2008

If you are looking to write a web crawler, Perl, with all its great CPAN modules, is one of the best platforms you can pick. There are CPAN modules for most of the common components of a web crawler. Here, I’ll point to some of the modules that you would want to start out with.

Read on…

This entry was posted in Crawling and tagged , . Bookmark the permalink. Post a comment or leave a trackback: Trackback URL.

3 Comments

  1. Jack
    Posted October 16, 2008 at 3:27 pm | Permalink

    check this article about web crawling,

    http://crawltheweb.blogspot.com/

  2. edmar
    Posted November 25, 2008 at 11:49 pm | Permalink

    the blog is nice..but it is be nice if it will be included with examples..like for WWW::Mechanize..

    tnx..

  3. Kiran
    Posted April 1, 2009 at 11:59 am | Permalink

    Thanks for the useful information.

    Regards,
    kiran Kumar. Bodi

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*

  • About grok.in

    This is a blog primarily focussed on the subjects of Information Engineering—Retrieval, Extraction & Management, Machine Learning, Scalability and Cloud Computing.