web scraping high volume cost optimization
$250-750 USD
Dibayar semasa penghantaran
looking for someone very knowledgeable that will be able to advise us and integrate the best cost efficient solution at high volume/scale for scraping ecommerce (we are talking about 5m products, twice a day) , dont apply if you do not have experience at this scale.
we do not need the scraper itself we wrote it in python and it is already working
ID Projek: #28572358
Tentang projek
22 pekerja bebas membida secara purata $619 untuk pekerjaan ini
Hey there, I have 4 years of working experience in web technologies and I have a strong working knowledge of every possible framework which is in the market. In terms of client-end I know: Web Scraping, Python, Amazon Lagi
Hi, Greetings! ✅checked your project details: web scraping high volume cost optimization ✅Completed Time: In project deadline We have worked on 640 + Projects. I have 6 + years of the experience in same kind of Lagi
Good day. I am a top talent python scraping expert with extensive experience. I have complete many similar projects using frameworks and libraries such as scrapy, selenium, requests, beautifulsoup, lxml and etc, As an Lagi
Hello, I have read your job description it is a fairly simple job and I can do it with ease and complete it in a short amount of time. Thanking you in anticipation. Best Regards, faizan
AWS certified developer here! "we do not need the scraper itself we wrote it in python and it is already working "- You already made the work even more easier .Don't trust the bots which are spamming this bid list- the Lagi
Hi, The best way to scrap high volume data is to use threads (i coded some scraper with 500 threads working in parallel). I case your ip address is blocked by the website to scrap you can use different proxies for each Lagi
Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio and reviews on my prev Lagi
Hello , we can create the script for ecommece scrapping for scrapper 5M products , we have the highly skilled developer of web scrapper, python scrapper, please check my portfolio https://www.freelancer.in/u/arjun36633 Lagi
Hello, I'm an AI expert in the fields of scrapping, deep learning and some python application developing in the field of IoT, Robotics and Data Science. I'm very keen on taking your project and enjoy putting it into pr Lagi
Nice to meet you I am an Amazon Cloud Architect for the web infrastructure serving 90 million page impressions and 12 TB Internet traffic per month. The AWS services I use are EC2, ELB, MySQL RDS, VPC, CloudFront, Elas Lagi
Hey there, I am interested in your project. As i see the requirements, you want to scrape around 2M data twice a day. I'm thinking of threading in this case or we can setup some cron jobs and run it with the help of Lagi
Hello, I am full time freelancer working in data science field in which web scraping is my one of the expertise. At first glance of your allotted task, I am able to complete it with your given constraints. If possible Lagi