Scrapy/Nutch backend
€30-250 EUR
Dibayar semasa penghantaran
Hi there,
I would like to build a price comparison website. However instead of using the standard API's that most websites use I want to scrape my own data.
I need a backend to easily add document languages, URL's and the data/facets that I want to have scraped.
Data has to be exported to Solr.
The end results of the website would be looking like this:
[login to view URL]
[login to view URL]
(with all the different facets for different categories)
[login to view URL]
(with all stores listed and historical price)
While I have no experience at all with this type of website I need advice along the way. I have enough technical experience to make decisions,, you just need to lay them out.
If you can, please give me 2 prices. 1 for just the scraper + easy backend and export to Solr and data stored in a format compatible with a website like above.
A second price with all of the above but with the full price comparison website as well.
ID Projek: #27214159
Tentang projek
8 pekerja bebas membida secara purata €225 untuk pekerjaan ini
I read your job description in carefully and I'm sure that do it smoothly. I'm full-stack developer and familiar with Django. My skills and experience is the following that match your job. ?? Django ?? familiar w Lagi
I'm new in freelancer but i'm experienced in webscraping. And i know document based databases like solr. I can write scrapy script and storing data. For second part (price comparision website) description is not clear. Lagi