VB.Net Multithreaded Web Scraper

I need multithreaded VB.Net source that scrapes like this:

1. Pick urls from a list (can be from a list of any kind - you make it up. From a text file or an array or a database - not important)

2. Go and scrape each url. No need to save the contents of the scrape - I am just interested in the overall logic and how the multithreading works.

I'd like to be able to set the number of simultaneous threads.

The scraping should show how to use the most basic scrape (i.e. no javascript support) as well as using Watin - both in multithread. I already know how Watin works - I've just never multi threaded it.

If you plan to use any commercial library, I need to know beforehand so I know the cost.

I use Visual Studio 10 and Windows 7 x64 and the source must run on this.

Kemahiran: .NET, Pengikisan Web

Lihat lagi: visual basic multithread scraper, multithread scraper, simultaneous web scrape, multithreading web scraping, visual web scraper, watin multithreaded, multithread scraping, web d cost, visual basic net array, vb.net if, vb net array, using array in vb net, use of vb net, use in vb.net, if vb net, how to use vb net, how to use in vb.net, web scraping library visual studio, watin multithread, multithreaded web scraper, vb.net list, vb.net, multi-threaded, list vb.net, e vb

Tentang Majikan:
( 13 ulasan ) Box Hill, Australia

ID Projek: #1589761

Dianugerahkan kepada:


Hi, I have gone through your requirement and I am glad that We can accomplish this task,as I have ready mutlithreaded scraper . Only I need to make some changes for you . Please give us opportunity to work with Lagi

$175 AUD dalam sehari
(33 Ulasan)

7 pekerja bebas membida secara purata $214 untuk pekerjaan ini


Please check my message.

$250 AUD dalam 2 hari
(48 Ulasan)

Hello Mate, We have 6 years of experience of core development and we have Experienced team. Please check our PMB for brief details.

$235 AUD dalam 5 hari
(23 Ulasan)

Vb.net Whiz here. Please see PMB

$250 AUD dalam 0 hari
(12 Ulasan)

Hi, I have very good experience in web scrapping. I can do this. Please check PM for more details.

$200 AUD dalam 7 hari
(2 Ulasan)

i can easily do this job. kindly go through my resume.i am also sending you my previous [url removed, login to view] go through that.

$230 AUD dalam 5 hari
(1 Ulasan)

Hello :) I have different web scrapers ready for your perusal. I am an expert in web scraping and building web scrapers.

$160 AUD dalam 0 hari
(2 Ulasan)

Pls check PMB.

$250 AUD dalam sehari
(0 Ulasan)