Scrapy Jobs

I have roughly ten thousand ISBN-13 codes and I need a production-ready Python pipeline that can take those codes, pull the corresponding book details from , , and a small set of external APIs, then push the cleaned results straight into a Google Sheets workbook. The pipeline must • survive Amazon’s throttling, bot checks, and page format changes without manual babysitting, • finish a full run on 10 k titles in a single session without crashing or silently skipping rows, and • give me fields that are already matched and normalised so downstream staff can link them to our catalogue instantly. Architecture is up to you: Scrapy, Playwright, headless Chrome, rotating residential proxies, Selenium, or a custom HTTP solution—whichever mix keeps the request foot...

I have roughly ten thousand ISBN-13 codes and I need a production-ready Python pipeline that can take those codes, pull the corresponding book details from , , and a small set of external APIs, then push the cleaned results straight into a Google Sheets workbook. The pipeline must • survive Amazon’s throttling, bot checks, and page format changes without manual babysitting, • finish a full run on 10 k titles in a single session without crashing or silently skipping rows, and • give me fields that are already matched and normalised so downstream staff can link them to our catalogue instantly. Architecture is up to you: Scrapy, Playwright, headless Chrome, rotating residential proxies, Selenium, or a custom HTTP solution—whichever mix keeps the request foot...

I’m compiling a comprehensive list of Australian-based IT companies and service providers. For each company I need two things captured accurately: up-to-date contact details (website, email, phone, physical address where available) and a clear summary of the services they offer. Your task is to source this information via web scraping, clean it, and deliver it in a structured spreadsheet or CSV . The data must be gathered only from publicly available, reputable sources; if you already know reliable sites or industry listings, feel free to leverage them, and you can also suggest new sources if they improve coverage. I’ll provide any seed lists I have once we start, but please assume you’ll need to expand well beyond those. Acceptance criteria • Minimum record ...

I’m collecting a new pool of Real Estate buyer leads and I need someone who can scrape the web efficiently and ethically to deliver accurate contact details. The focus is strictly on buyers— not sellers, not agents— so every record you gather should belong to an individual or entity actively looking to purchase property. All I need for each lead is clean, current contact information (name, working email, and phone number where available). No property preferences or past purchase history are required at this stage. Please pull from reputable, publicly accessible sources only and respect site terms of service while harvesting data. I’m happy to discuss your preferred stack—Python, Scrapy, BeautifulSoup, Apify, browser automation, or any combination that ensure...

I need to extract data from a vbulletin forum I’ll consider the job complete when: • The script successfully processes the sample list I provide and outputs the data file with all post content intact. • It includes brief setup instructions plus any requirements.txt. • Your code handles basic anti-scraping measures (e.g., polite delays) so the forum isn’t overwhelmed. Let me know your estimated turnaround and any clarifications you need, and we can get started right away.