Find Jobs
Hire Freelancers

Data scraping for public ecommerce site (2 sites)

€250-750 EUR

Ditutup
Disiarkan hampir 3 tahun yang lalu

€250-750 EUR

Dibayar semasa penghantaran
I need a customized program to scrap data (and calculation) from an online ecommerce platform. I want to scrap data from these ecommerce sites , esp. inventory and sales quantity. The program shall read user input excel file every day to check what categories are required for scrapping data. I need at least 30 categories within 20 hours, first 2 pages of products (SKU) for each category, i.e. 100 SKU for each category, total 3,000 SKU for 1 site. The same for the other sites. 2 programs shall run independently, 1 for each site, to scrap the data. The program shall be able to run 7x24 in a VPS environment. Developer shall suggest a reliable and reasonable cost VPS provider. Output excel file for each scraping data shall be uploaded to Google Drive and sent by auto-mail. Only the latest file shall be stored in Google Drive - that is old file shall be cleared from Google Drive. There is NO API available from ecommerce site. The sites are blocking IP address, proxy etc. Developer shall be able to handle platform robot detection, captcha, proxy blocking, rate limitation etc. If proxy service is required, developer shall advise such service provider and monthly cost, in addition to handle the work. Good database design and management are necessary. Developer shall provide 3 months warranty to ensure the program can run 7x24 in VPS server. Developer shall also quote monthly maintenance cost. Document and all necessary information shall be provided to ensure buyer can have 3rd party to do maintenance work (both the script and VPS set up details) in another VPS server if required. Developer shall support to have additional VPS server to run additional categories data without additional charge. Buyer will pay for VPS and proxy service every month after deploy. Developer shall include the cost for 1 month proxy service required (in addition to free proxy service) during development and testing. 1st milestone payment 5% - is to cover 1 month proxy service if free proxy service is not working. 2nd milestone payment 75% - when the project testing is completed (7x24). If problems occurs, it shall be counted from beginning. Full documentation and code provided. 3rd milestone payment 20% - after 3 months warranty Applicant shall submit a sample of data fetching result (50 SKU) in order to understand data requirement and corresponding ecommerce site. Applicant shall also recommend the selected VPS and Proxy service. Base on recommendation, applicant shall inform buyer the monthly charge of such service after deployment. Buyer confirmation of such charge is a pre-requisite to start any work. Only serious and professional shall contact me for detail and project requirement documentation. Please include 7 days verification in VPS environment in project time. Seller shall adhere to committed project completion date. Only serious seller shall apply. DO NOT auto bid the project. DO NOT send low price bid and then increase bidding price significantly. Only serious seller who provide sample files, suggested VPS, proxy service will be considered. Seller shall be able to offer response within 24 hours during warranty period.
ID Projek: 30333508

Tentang projek

11 cadangan
Projek jarak jauh
Aktif 3 tahun yang lalu

Ingin menjana wang?

Faedah membida di Freelancer

Tetapkan bajet dan garis masa anda
Dapatkan bayaran untuk kerja anda
Tuliskan cadangan anda
Ianya percuma untuk mendaftar dan membida pekerjaan
11 pekerja bebas membida secara purata €576 EUR untuk pekerjaan ini
Avatar Pengguna
Hey Manager!! We checked for your project and interested in your project. Project: Data scraping for public ecommerce site (2 sites) I am professional full stack software engineer with skills including Selenium, Software Architecture, PHP, Web Scraping and Database Programming.
 I have done several complex projects and provide continuous maintenance support. My goal has always been to provide reliable and efficient to my clients and so far I have been quite successful. I won't delay your project and will keep you updated with constant feedback and status of the work My Full Stack Development Skills 1. Frontend: Front-End HTML5, CSS/CSS 3, JavaScript, 2. Server Administration: Amazon Web Services, Digital Ocean, LAMP, Cloud, Apache, Apache Tomcat, NGINX. 3. Backend: PHP, GoLang, Ruby, Python, Laravel, CI, CakePHP. 4. Databases: Mysql, Oracle, PostgreSQL, MS SQL, SQLite, MongoDB. 5. Testing: Manual & Automation testing. 6. Frameworks: Angular Js, React JS, Symfony2, Laravel, Silex, Spring MVC, Rails, Django, Pyramid, Protractor, Selenium, Blockchain, Etherume, Vuejs 7. UI/UX: Photoshop, Sketch, Zeplin, Invision, Moqups. Type of projects we have delivered to our global clients: a. Enterprise Software Development, b. CRM Development, c. SAAS Product Development c. Web/Mobile Based Application development. d. All CMS website: Wordpress, Magento, Joomla, e. HRMS Software f. Multi-level Marketing (MLM) with crypto payment gateway f. E-commerce installation and customization g. Crypto Exchange Development Please send a message to discuss more regarding this project.
€610 EUR dalam 16 hari
4.9 (43 ulasan)
6.7
6.7
Avatar Pengguna
Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered results as per your requirement, In the format you want. You can also ask for data into a particular format - Excel, Json, Mysql, Databases, XMLs, you name them. Further Can help you with integrating it with ur databases, Can create json outputs. We are not only good with scraping but also with the tools that u may need after that. We can help you build you softwares round the data we have 99% Data Accuracy. We have Duplicate finder. etc., We can help with Statistics on the data We can help with creating Api's front the data We can create Softwares to manage that data We can build Sites round the data
€722 EUR dalam 2 hari
5.0 (14 ulasan)
6.3
6.3
Avatar Pengguna
Hello Hiring Manager, I read your job descriptions carefully, I am very interesting in your job of Data scraping for public ecommerce site (2 sites) I have the enough experience and good project done with good client feedbacks. Let me know if we can discuss further? Regards Himanshu
€500 EUR dalam 7 hari
5.0 (9 ulasan)
5.6
5.6
Avatar Pengguna
Hi there. How are you? I have read your posting and I am very interested in your project. I am an expert of web scraping in PHP, Python, C#, Java. And I can use curl, selenium, javascript, etc. Let me share my experience on our private chat. I will wait for your response. I can perfectly satisfy you. I want a long-term relationship with you. Thank you.
€500 EUR dalam 7 hari
5.0 (11 ulasan)
5.1
5.1
Avatar Pengguna
I read your request . i can do all thing you want. I have worked in various fields of programming and web scraping with python and I can do your project using the beautifulSoup ,scrapy(spiders) ,requests and Selenium library in the shortest time and at the lowest price and save that on an excel file. I can also create a new Excel file each time the code is executed so that you have the previous information , if you want !! I can change anything you want And I will share it with you step by step also I have done many projects on popular sites such as amazon, ebay and.... Before starting work, you can see a sample of my work , please send me a message on the chat page to send you a sample work. I'm interested to find out more details, if you find our work interesting we can connect more. My aim is to provide satisfied and quality work
€500 EUR dalam 7 hari
5.0 (13 ulasan)
4.4
4.4
Avatar Pengguna
We are a team specialized in offering services of software quality assurance and have 4 years experience in this field. Our team is applicable and ready to define or get outsourced software QA projects from all around the world. We are able to work in different time zones. We work with hourly rate of 9-15 USD/hour. Our Services: - Automated E2E Testing (Web) - Automated E2E Testing (Android, iOS) - API Testing - Unit Testing - Performance Testing - Security Testing Various vulnerability scanning & security testing tools are used including: Acunetix, w3af, Wireshark, etc. - Implementation of Continuous Integration - Implementation of Monitoring Sentry, Fluent, etc. - Consulting Services to Revise Processes of Agile Projects to Improve Technical Quality of Projects - Outer Monitoring & Assessment for The Quality of Execution of Various Parts of SDLC
€500 EUR dalam 35 hari
5.0 (2 ulasan)
4.0
4.0
Avatar Pengguna
======= Webscrapping Expert ========== Hi, bro! I have read your requirement and I noticed that I am appropriate to this project. As a skillful software developer, I have rich experience with C# .net, python web scrapping with Selenium programming and finished many projects like this. I promise I will finish lots of webscrapping projects with high quality on time. I scrapped many websites like as IGDB, wikipedia, GDP statistics with python and c# selenium I hope you to contact me so that we have a full discuss with the project. Best regard!
€500 EUR dalam 2 hari
5.0 (2 ulasan)
0.5
0.5
Avatar Pengguna
Hi, I'm a senior in Website and App Development. I read the job details extremely carefully. I think I can help you to complete your project with my rich knowledge and experience. I'm ready to do it now. Should you require further assistance, feel free to contact me on +918987527635.
€500 EUR dalam 7 hari
0.0 (0 ulasan)
0.0
0.0
Avatar Pengguna
Hi, I hope you will be fine. I read all your required project detail and wanna to work with you. We are company and we work from 2002, we have right now 1000+ staff in different IT fields. We Start freelancing now also. We are professionals and want to improve our capabilities through our skills and with our professional work. We will give you 100% Guarantee result with 24/7 result, we are here for your help for day and night. We will give you daily, weekly and monthly report also. We will use Jira and trello for daily task management. You will be happy to work with us. Thanks.
€750 EUR dalam 15 hari
0.0 (0 ulasan)
0.0
0.0

Tentang klien

Bendera GERMANY
Frankfurt am Main, Germany
0.0
0
Ahli sejak Mei 28, 2021

Pengesahan Klien

Terima kasih! Kami telah menghantar pautan melalui e-mel kepada anda untuk menuntut kredit percuma anda.
Sesuatu telah berlaku semasa menghantar e-mel anda. Sila cuba lagi.
Pengguna Berdaftar Jumlah Pekerjaan Disiarkan
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Memuatkan pratonton
Kebenaran diberikan untuk Geolocation.
Sesi log masuk anda telah luput dan telah dilog keluar. Sila log masuk sekali lagi.