Yahoo/Google query to extract company web pages

Lengkap Disiarkan Jul 9, 2012 Dibayar semasa penghantaran
Lengkap Dibayar semasa penghantaran

We have a list of societies with their physical adress (1m. records) We would like a system to extract the company web page.

We have made up a system but it is slow and complicated to parametrize. The idea is to have one that is automatical and does not need to be manually revised.

EG: Name of company, adress.

[url removed, login to view]

We would prefer to do it via google but it blocks out the ip very quickly.

Our system is to get a list in yahoo and plugg in their language (eg: [url removed, login to view] etc.) and process it. We get the 10 first results and save it in an excel. Company X, has 10 results.

The system has to filter out directories that repeat (in different searches), and try to get the unique dominion that has the company web page.

Actual System.

From excel plug in the name and adrees

translate it to yahoo searcher.

copy paste to program

run program

visually check that it is not blocked

when blocked restart modem

wait 2 min and so on.

Need of a better system.

Possible improvements: one archive (if bigger of 1m and just forget the system the better) all results. Archive result name of company, adress, and diffrent columns and the most likely web page.

Pemasukan Data Pemprosesan Data Web Scraping Carian Web

ID Projek: #1746752

Tentang projek

17 cadangan Projek jarak jauh Aktif Jul 31, 2012

Dianugerahkan kepada:

wewahala

Professional solution. Let's discuss.

€580 EUR dalam 30 hari
(10 Ulasan)
5.0

17 pekerja bebas membida secara purata €374 untuk pekerjaan ini

greggfletcher

Hello, please check your PMB. I have some suggestions for you.

€400 EUR dalam 10 hari
(60 Ulasan)
6.5
Rajni0802

We can do this task. Please review PM for further details.

€500 EUR dalam 3 hari
(16 Ulasan)
4.7
dsendra

We have wide experience in web scrapping, we specialize in data-mining software. VB 6, VB.Net desktop applications. Yellow pages, forums, classified sites, directories and others are some of the areas we've developed c Lagi

€350 EUR dalam 2 hari
(17 Ulasan)
4.7
zbone

Hey I can do the job, I have a long experience in the industry. Please let me know when to start

€320 EUR dalam 5 hari
(2 Ulasan)
2.9
smritisolutions

Hello Sir, We are expert in Java based scraper , Have successfully completed more than 60+ bots for different websites. Please check your PMB for more details.

€600 EUR dalam 7 hari
(0 Ulasan)
0.0
trunix

Hi, i can help you

€300 EUR dalam 5 hari
(0 Ulasan)
0.0
ashok2574649

give me an opportunity I will definitely satisfy you with my work and efficiency

€250 EUR dalam 7 hari
(0 Ulasan)
0.0
mati233

Check your PMB for more details please.

€250 EUR dalam 3 hari
(0 Ulasan)
0.0
Tanvi1980

Ready to start instantly. Please provide further details.

€250 EUR dalam 5 hari
(0 Ulasan)
0.0
ruifortes

Sou arquitecto de formação mas sempre gostei de programação área que estou actualmente a investir. Tenho bons conhecimentos de php,xml, xslt e regex que penso serem indespensaveis para esta situação assim como Lagi

€400 EUR dalam 4 hari
(0 Ulasan)
0.0
metalha

Hi Sir, I am well versed in a couple of languages and i am particularly very good at writing web scraping and data mining scripts. If you want to see some previous work i am willing to provide you with urls and samp Lagi

€360 EUR dalam 3 hari
(0 Ulasan)
0.0
Thelancer28

Please check your PMB

€750 EUR dalam 8 hari
(0 Ulasan)
0.0
maredefjore

Hi ! I had sucessfully designed more than 100 bots and its perfectly fits with your requests; looking forward to proceede

€250 EUR dalam 2 hari
(0 Ulasan)
0.0
udesraju

Dear hiring manager we are ready to start .Can be done please check your PMB.

€300 EUR dalam 7 hari
(0 Ulasan)
0.0
lizakhan

Hi, I am ready to do this job.

€250 EUR dalam 30 hari
(0 Ulasan)
0.0