Monday 19 January 2015

Indexer and Scraper

Indexer

Scraper

Indexer

This indexer index's a page and all their subpages. It can scrapes Links, images links, video links, iframe links, embed links.

mywebsite.com > forum > sign up, profile, login, logout
                          > products > downloads
                          > contact us

Match Text

Only scrape urls that contains the text. If you only want to scrape http://mywebsite.com you should use "mywebsite.com" as the match text.

Scraper

This scraper takes a list of urls and returns links, image links.

If you find any problems please post them here and i will try to fix it. Feel free to make suggestion and ask me to add functionality.

Requirements:

.NET Framework 4.5

Download

 - Indexer & Scraper-1.0

No comments:

Post a Comment