A web scraper which will take a URL (homepage) and scrape all internal links (specify the depth of urls to get). Then go to each internal link and scrape each internal link. (NOT MULTI-THREADED!)
From this list of URLs it will extract the content (from a DIV) and remove all HTML ([login to view URL]), leaving text only.
The output will be each pages text as a .txt file.
I will require the source code and it's to be written in VB.NET