
Open
Posted
•
Ends in 1 day
Paid on delivery
I need a robust web-scraping solution that automatically collects product information from several e-commerce websites. The focus is on two key data points: • Product name and full description • Customer reviews and ratings Price and availability are not required this time, so the crawler can ignore any endpoints related to stock or cost. Please build the script so I can run it on demand and easily point it at new store URLs in the future. Python with BeautifulSoup, Scrapy, or a similar framework suits me fine, as long as the code is clean, well-commented, and leverages polite scraping practices (respectful delays, user-agent rotation, handling captchas when possible). Deliverables: 1. Working scraper code with clear setup instructions 2. Sample CSV or JSON export containing the requested fields 3. Short README explaining how to tweak the target domains and data selectors I will test by running the script against two live e-commerce sites and verifying that the exported file matches the page content for a random sample of products.
Project ID: 40376947
33 proposals
Open for bidding
Remote project
Active 4 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
33 freelancers are bidding on average ₹28,159 INR for this job

As an industry expert with over 18 years of experience, CnELIndia is the team you need to execute your ambitious web scraping project. Our proficiency in technologies such as PHP, Python, and particularly web scraping will prove vital in building a robust and efficient crawler for your e-commerce product information needs. We understand the importance of detail in your endeavor and will ensure our resulting scraper provides you with everything you require - product names, full descriptions, and customer reviews and ratings. We're skilled in leveraging tools such as BeautifulSoup, Scrapy, as well as other similar frameworks, so you can be confident that we'll deliver clean and well-commented code that meets your specifications. Lastly, we're acutely aware of the need for ethical practices in scraping processes. Our approach has always been anchored on respectful delays, rotating user-agents, and cleverly handling captchas whenever possible to maintain the integrity of sites being scraped. You can trust us to always operate within legal boundaries while ensuring maximum extraction efficiency. So, why settle for less when you can team up with industry leaders? Choose CnELIndia for a first-class e-commerce Product Scraper solution.
₹35,000 INR in 7 days
9.0
9.0

Hello, I will build a modular Python scraper (Scrapy/BeautifulSoup) with configurable selectors, polite scraping (delays, headers, retry logic), and export to CSV/JSON along with clear setup and usage instructions. With 10+ years of experience in web scraping and data extraction, I deliver reliable, scalable scripts that are easy to maintain and adapt to new sites. Let’s connect in chat to review your target websites and finalize the scraping approach. thank you Regards Gaurav Garg
₹25,000 INR in 7 days
8.5
8.5

Hi, I will build a Python scraper — using Scrapy with rotating user-agents and polite delay settings — that extracts product names, descriptions, reviews, and ratings from your target e-commerce sites, outputting clean CSV and JSON exports. I will structure the spiders with a config file where each domain has its own selector map, so pointing at a new store means adding a few CSS/XPath selectors without touching core logic. Questions: 1) Which e-commerce sites will I scrape first — are any JavaScript-heavy (requiring Playwright)? 2) What volume of products per site do you expect per run? Send me a message and we can go over the details. Best regards, Kamran
₹24,746 INR in 10 days
8.4
8.4

Hi there, I have read your project requirement carefully. You need a scalable web scraping solution to extract product names, descriptions, and customer reviews/ratings from multiple e-commerce websites with clean, reusable, and well-documented Python code. We will build a robust scraper using Python (Scrapy/BeautifulSoup), with modular structure so you can easily plug in new URLs and selectors. The script will follow polite scraping practices including delays, user-agent rotation, and basic anti-bot handling. Output will be provided in structured CSV/JSON format along with clear setup instructions and a README for future customization. Before we proceed, I have a few questions: =================================== Which specific e-commerce websites should we target initially? Do you prefer Scrapy (scalable) or simple BeautifulSoup-based scripts? Should reviews include full text or only summary/ratings? Do you need pagination and multi-product crawling from category pages? Best Regards, Srashtasoft Team
₹35,000 INR in 12 days
6.3
6.3

Your scraper will fail the moment one of those e-commerce sites updates their DOM structure or implements Cloudflare bot detection. I've seen this exact scenario break production pipelines for 3 retail clients who tried building in-house scrapers without fallback strategies. Before I architect the solution, I need clarity on two things: 1. Are these sites using JavaScript-heavy frameworks like React or Vue that require headless browser rendering, or are they server-side rendered HTML? 2. What's your tolerance for downtime if a site blocks your IP range? Do you have proxy rotation infrastructure in place, or should I build that into the scraper? Here's the architectural approach: - SCRAPY + ROTATING PROXIES: Build a distributed scraping framework with automatic IP rotation and exponential backoff to avoid rate limits and IP bans that kill 80% of amateur scrapers. - BEAUTIFULSOUP + SELENIUM FALLBACK: Parse static HTML with BeautifulSoup for speed, but automatically switch to Selenium when JavaScript rendering is detected, ensuring you capture dynamically loaded reviews. - DATA VALIDATION LAYER: Implement schema validation using Pydantic to catch malformed data before export, preventing garbage CSV files that waste your QA time. - SELECTOR ABSTRACTION: Store CSS selectors in a separate JSON config file so you can retarget new domains in 30 seconds without touching the core scraping logic. - CAPTCHA HANDLING: Integrate 2Captcha API hooks for sites using reCAPTCHA, with graceful degradation if the service is down. I've built 7 production scrapers that process 500K+ product records daily without getting blocked. Let's schedule a 15-minute call to walk through the target sites and identify anti-bot measures before I start development.
₹22,500 INR in 7 days
6.2
6.2

Hi there, With 20+ years of experience in front-end and back-end development, I provide high-performance, scalable solutions tailored to your needs. I specialize in building robust architectures and seamless user interfaces that drive results. Why choose me? 20+ Years Expertise: Deep mastery of the full development lifecycle. Full-Stack Proficiency: Expert front-end and back-end integration. Reliability: Clean, maintainable code delivered on time. Let's discuss how I can bring your vision to life!
₹37,500 INR in 4 days
6.1
6.1

As an astute Fullstack Developer with a specialized focus on robust web scraping solutions, I have every confidence that my expertise meets the specific needs of this project. Over my commendable 6 years of experience, I've accrued significant skills in ASP.NET, .NET and Python - technologies tailor-made for tasks as intricate as web scraping. My familiarity with a wide range of Content Management Systems including WordPress, Shopify, Wix, and Prestashop is also a value-add to this project. It means I can fully understand your eCommerce website environments' structure and characteristics in order to best streamline the scraping process for you. Moreover, my proficiency in MSSQL, MySQL, SQLite, PostgreSQL is strategic as they will be instrumental in structuring and storing the vast amount of data we will be extracting. As an added plus, I am absolutely fluent in English ensuring effective communication throughout our collaboration process. Trust me to do an excellent job.
₹130,000 INR in 7 days
5.5
5.5

I can build a robust Python scraper (Scrapy/BeautifulSoup) that extracts product names, descriptions, reviews, and ratings with clean structure and reusable logic for new sites. I focus on polite scraping, modular code, and clear docs so you can run and extend it easily anytime. Let’s deliver a solid, scalable solution.
₹12,500 INR in 1 day
5.4
5.4

Hi, As per my understanding: You require a custom Python-based web scraping tool designed to extract product titles, descriptions, and customer feedback from various e-commerce platforms. The goal is a reusable script that avoids price or stock data, focusing instead on high-quality content and sentiment data. I understand that the solution must be scalable, allowing you to add new target URLs easily by adjusting data selectors. My approach ensures the code is modular, clean, and follows ethical scraping guidelines to prevent IP blocks while maintaining high data integrity for your CSV or JSON exports. Implementation approach: I will develop the scraper using the Scrapy framework due to its superior handling of concurrent requests and middle-ware support. To manage different site structures, I will implement a configuration-based design where CSS selectors and XPaths are stored in a separate YAML file. This allows you to add new stores without rewriting core logic. For polite scraping, I will integrate an automated user-agent rotator and implement randomized download delays. To handle customer reviews often loaded via JavaScript, I will use Playwright integration where necessary. The final package will include a structured README and a sample dataset to verify the extraction logic.
₹25,000 INR in 7 days
5.6
5.6

Hi there, I can build a reliable and scalable web scraping solution that collects product names, descriptions, and customer reviews with clean, structured output. I will develop the scraper using Python with Scrapy or BeautifulSoup depending on the site complexity. The code will be modular so you can easily point it to new e commerce websites by updating selectors or configuration, without rewriting the core logic. The scraper will follow polite scraping practices including request delays, user agent rotation, and basic handling for blocks or rate limits. I will also ensure clean extraction of review data, including ratings and text, while ignoring price and stock related elements as requested. Let’s connect to discuss and start work! Thanks Saurabh
₹16,500 INR in 7 days
5.4
5.4

Having spent over 7 year working as a Full-Stack Developer, I've garnered extensive experience in web scraping. My skills in Python programming language and frameworks such as BeautifulSoup and Scrapy would be invaluable in creating the robust web-scraping solution that you need. Additionally, I understand the importance of clean, well-commented code that adheres to best scraping etiquette. My solid understanding of the structure of e-commerce websites puts me in a great position to develop a tailor-made solution to your unique needs. Over the years, I’ve built resilience by consistently delivering projects on time (98%+) without compromising on quality. By choosing me, not only do you benefit from a reliable team player but also from someone who appreciates the intricacies of e-commerce. Furthermore, my wide-ranging proficiency in various languages (including PHP) and databases (MySQL, PostgreSQL) aligns perfectly with your project requirements. My goal isn't just to build something that works but rather to build a solution that will carry your business into the future by providing clear instructions for folder flexibility, detailed documentation on adaptation and an elegant end product that adds value and convenience to your operations.
₹25,000 INR in 7 days
4.4
4.4

Hello Already have something live to show you I am professional mobile software engineer with skills including Web Design, PHP, Website Development, Content Writing, Elementor, HTML, WordPress and Website Design. Please send a message to discuss more about this project. Always happy to hear from you Thanks
₹25,000 INR in 7 days
4.5
4.5

Hello. I have been looking at your project details and I can see exactly what you are trying to achieve. Instead of a standard setup, I want to build a WordPress solution that is specifically optimized for your goals, making sure the custom features and performance are perfectly aligned with what your business needs. I am ready to help you get this done efficiently. Let's have a quick chat to discuss the specifics and how I can make this work for you right away. Best regards, Angel
₹32,360 INR in 4 days
4.1
4.1

I'm Fahad, a tech-enthusiast with a keen eye for innovation and a vast set of practical skills under my belt in the realm of web technology. When it comes to your e-commerce scraping project, I bring to the table extensive expertise in Python, which makes it convenient for me to employ popular frameworks like BeautifulSoup and Scrapy to gather the necessary data while adhering to polite scraping etiquettes. Rest assured that your scraping solution will be clean, well-commented, and efficient. Over the years, my proficiency has extended not only in data collection but also in transforming that data into actionable insights. With this in mind, I'll ensure that alongside the working scraper code (which I'll set up and explain clearly), you'll get a comprehensive README document that will ease any future tweaks or adjustments you might wish to make. Additionally, I'll provide sample exports in CSV/JSON format encompassing the specific data you need for your analysis – product names and descriptions, customer reviews, and ratings - so you can verify against live site content. In summary, my technical knowledge in Python and meticulous approach towards web projects suits perfectly to create your sophisticated e-commerce data scraping tool. Together we'll build a scraping platform that transforms your business providing the most competitive edge possible. Let's discuss your detailed requirements today!
₹20,000 INR in 7 days
4.0
4.0

Hello, I understand you need a flexible and reliable scraping pipeline focused on product content and reviews, and my approach would be: URL input → request handling with headers/user-agent rotation + rate limiting → parsing via BeautifulSoup/Scrapy → structured extraction (name, description, reviews, ratings) → pagination handling → anti-block measures (retry logic, optional proxy support) → clean data pipeline → export to CSV/JSON → modular config so new sites can be added by just updating selectors; I’ll keep the code well-structured, commented, and easy to extend while ensuring polite scraping practices, and I can also share similar scraping/data pipeline work for reference, so if you want a stable and reusable scraper, let’s connect.
₹25,000 INR in 7 days
3.2
3.2

Drawing on my extensive 8+ years of experience, I'm well-equipped to take on your web scraping project. My deep understanding of Python and its frameworks such as BeautifulSoup and Scrapy make me highly proficient in high-level web parsing and data scraping - skills that are essential for this undertaking. More so, my adaptability and quick learning ensures I'll be able to swiftly learn and employ any additional tools that might be specific to the e-commerce sites you want to target. My previous projects have allowed me to develop strong attention to detail which is essential for collecting precise data like product names, descriptions, customer reviews, and ratings – which interestingly aligns with your project's core objectives. Also pertinent is my proficiency in delivering clean well-commented code, complete with a detailed README. This means not only will you obtain an efficient scraper but will also gain insight into how to customize it should your future needs change.
₹25,000 INR in 7 days
2.9
2.9

Hello, Your ecommerce scraping needs cover product names, full descriptions, and customer reviews while ignoring price and stock data. I will build a Python scraper using BeautifulSoup and Scrapy that runs on demand and handles polite delays, user agent rotation, and basic captcha challenges. You will be able to point the script at new store URLs easily by editing a simple config file. I can start immediately. Please share two example store URLs and the specific CSS selectors for product names, descriptions, and reviews. Best regards, Jean
₹18,000 INR in 4 days
2.1
2.1

✅✅ Hi there ✅✅ I understand the need for a precise web-scraping solution to extract product information from various e-commerce websites. My expertise lies in developing Python-based scrapers using BeautifulSoup and Scrapy, ensuring clean code with thorough comments and adherence to best scraping practices. I propose to create a customizable scraper that focuses on product details and customer reviews, excluding price and availability. The script will be user-friendly, allowing you to easily adapt it to new store URLs in the future. I will deliver a functional scraper with setup instructions, a sample CSV or JSON export, and a detailed README for seamless usage. With my experience in web scraping and Python frameworks, I am confident in delivering a high-quality solution that meets your requirements. Let's work together to streamline your data collection process efficiently. Anton D
₹25,000 INR in 7 days
1.9
1.9

Hello! We carefully reviewed the description of your project and can confirm that we fully understand your requirements. We are very interested in building your web-scraping solution and confident in delivering a clean, flexible, and reliable system. With over 25 years of experience, our team has strong expertise in Python scraping frameworks like Scrapy and Beautiful Soup, including handling dynamic content, reviews extraction, and scalable crawler design. Approach: We recommend using Scrapy for a structured and extendable solution. The scraper will extract product name, full description, and customer reviews/ratings while ignoring price and availability. We will design it in a modular way so you can easily plug in new e-commerce sites by updating selectors or adding spiders. We will implement polite scraping practices—rate limiting, retry logic, rotating user-agents, and basic anti-bot handling where applicable. Output will be exportable to CSV/JSON. You will receive: • Clean, well-commented code • Sample output file • README with setup, usage, and how to add new domains We would be happy to discuss your target sites. Best regards, Dr. Rajesh Rolen
₹25,000 INR in 7 days
0.9
0.9

As a seasoned Full Stack Developer and automation enthusiast, I possess all the skills necessary to create an efficient and flexible e-commerce product scraper for you. Being well-versed in Python along with BeautifulSoup, Scrapy, I have substantial experience in web scraping and data extraction. Furthermore, my proficiency in leveraging polite scraping practices such as respectful delays, user-agent rotation, and captcha handling when possible ensures that your scraper will function responsibly and seamlessly across multiple e-commerce websites. My end goal is to provide you with a clean, well-documented code that not only meets but exceeds your expectations. To give you even more peace of mind, I intend to go beyond the deliverables of the working script and export by providing a short README. This will empower you to easily tweak target domains and data selectors yourself irrespective of any future changes in your requirements or URLs.
₹22,000 INR in 10 days
0.9
0.9

Kolkata, India
Member since Apr 16, 2026
₹1500-12500 INR
₹600-1500 INR
$250-750 USD
$30-250 USD
£10-15 GBP / hour
$15-25 USD / hour
₹1500-12500 INR
€250-750 EUR
$30-250 USD
$10-30 USD
$250-750 USD
$30-250 USD
$30-250 USD
$30-250 USD
$30-250 USD
₹750-1250 INR / hour
₹800-1000 INR
₹750-1250 INR / hour
₹1500-12500 INR
$250-750 USD