Write some Software

I need someone to scrape 2 web directories. It should be a fairly straight-forward project if you have skills in web scraping. You need to use your own scraping software.

The scraper will:

1. The first two steps are to go to 2 directories; Go to each listing and collect some information into an excel spreadsheet. There is a consistent structure tot he pages which should be easy to automate.

2. After this there is a final step. Once it has collected all the information from both directories, it will visit each of the websites discovered and collect the text from the opening page of the website and the "about", "mission" and "contact" pages. This should be collected into a separate spreadsheet.

The specs and example spreadsheets for each of the steps is listed in the enclosed file.


Sorry - left off specs

For some reason I can not upload the detailed specs. The detailed specs will include screenshots and example excel files. Below is a summary:

Go to this page and go through the approximately 618 entries:

Here is one example:
Fill in the Excel spreadsheet with the corresponding fields. There is also a field for the URL scraped.

Go to http://tinyurl.com/m9ktlfo and scrape for the approximately 288 entries

Here is an example:
Fill in the excel spreadsheet with the required fields

ITEM 3 (final step):
The final step is to go to each of the URLS collected in the first two steps i.e. all URLS listed in bc scrape example.xlsx and on scrape example.xlsx and collect the information on multiple pages from that website.
You will need to go to each page and get the text from each page. The text should be plain text without HTML. You should keep paragraph breaks and carriage returns though.
You should then crawl all pages on the site to find the “About us”, “Mission” and “contact us/locations” pages. You should locate those pages by looking for the keywords ABOUT/MISSION/CONTACT/LOCATION in EITHER the url or the anchor text. There will often not be those pages – not to worry. If there is more than one of those pages, just take the first.
If the excel spreadsheet gets too big, please just break into multiple files. An alternative is to save the text into individual files, and put the file name of each on into the excel spreadsheet.

Kemahiran: Pengikisan Web

Lihat lagi: Write some Software 2, websites it and software, Web Scraping Software , ToT, some software, easy web scraper, text file scraping, easy websites web scrape, contact information scraper, write file excel, excel spreadsheet structure, excel example web scraping, easy web scrape, scrape contact information website, scrape website excel spreadsheet, web scraping skills, need someone write text website, need someone write text, web scraping contact, scrape listing

Tentang Majikan:
( 14 ulasan ) Irvine, United States

ID Projek: #5419454

Dianugerahkan kepada:


Hello, I can help you with step 1 if you are interested. I am an expert in web scraping (ranked #1 for Web Scraping https://www.freelancer.com/freelancers/skills/Web_Scraping/). I have done many similar jobs. Pl Lagi

$60 USD dalam 2 hari
(78 Ulasan)

17 pekerja bebas membida secara purata $167 untuk pekerjaan ini


Hi I assume you want to collect info. from directories such as websites. Then you will visit each website, which data need to be extracted from each website? Thanks

$309 USD dalam 3 hari
(22 Ulasan)

I have done tons of scraping jobs all with excellent feedback. Please send me the description file and I'll update my bid accordingly.

$250 USD dalam 3 hari
(14 Ulasan)

Hi mpines I'm interested and I like to know more details about your project, please send me a message with the website's url from which you need the info. I write my own scripts to scrap websites and I have exp Lagi

$100 USD dalam 7 hari
(7 Ulasan)

Hello sir,I have 8 member team and good experience and we can start the work right now and also all communication and work will be high quality. all work will be done on my office and also without any [login to view URL]

$79 USD dalam 3 hari
(16 Ulasan)

Hi sir, Please send the details of directories. I'll send a sample before you accept my bid. I am unable to find any file in the project page. Please send it if possible. Thank you! Regards, Krishna

$100 USD dalam 5 hari
(13 Ulasan)

I write my own bespoke scraping solutions without using pre-built scraping software and can be as adaptable as needed to get your information. Typical barriers to scrapers such as javascript produced fields are no issu Lagi

$155 USD dalam 3 hari
(4 Ulasan)


$155 USD dalam 3 hari
(2 Ulasan)

Hello sir, I've been read all description carefully and i have have all tools and skills to scrap any website and if your website its need to scrap manually so no problem i have very good and hard working team so i can Lagi

$150 USD dalam 5 hari
(3 Ulasan)

*****Just a day back, i finished another project too...web scraping. I can provide the required data in the desired format. I can automate the task easily.**************** Good Day!.. I'm a VBA Programmer, having 6+ y Lagi

$150 USD dalam 2 hari
(0 Ulasan)

Greetings, Thank you for giving us a chance to bid on your project. We have looked at your project specs and we are confident that we can deliver you robust and reliable solution. We have successfully completed more th Lagi

$206 USD dalam 3 hari
(0 Ulasan)

i Am Not Saying that i Am the best but my coding skills show you that i em the best i am highly interested in this job I Can Start working on it right now ..Waiting for your response Thanks

$277 USD dalam 4 hari
(0 Ulasan)

Hello. I'm professional web developer since 2006. Experienced in: Ecommerce, social networks, classified ads, CMS, blogging, Web services Which websites must be scraped? Regards, Vitaliy

$210 USD dalam 10 hari
(0 Ulasan)

Hello. I have 10+ yrs experience as a software engineer, and plenty of experience creating scraping applications. Consequently, the final product will be of high quality and turnaround will be fast. I have my own s Lagi

$222 USD dalam 3 hari
(0 Ulasan)

I own a professional licenced web scraper and I am used to website scraping and excel file building from this tool. I'm also able to convert those excel files to any database. I have already did this for example to Lagi

$244 USD dalam 5 hari
(0 Ulasan)

Hi I am a PHP/MySQL expert and have scraped data form many sites using PHP scripts. The attachment you have mentioned is missing. Can you please send the attachment and the url of the directories, so that I can t Lagi

$90 USD dalam 5 hari
(0 Ulasan)

Hello Sir, We've done a number of web scraping projects for our clients. We have scraped many directory websites including yellowpages, yelp etc. We can deliver the data very quickly. If you want to see some sample Lagi

$78 USD dalam 3 hari
(0 Ulasan)