
Completed
Posted
Paid on delivery
I have to confirm whether specific street addresses qualify for the government-funded home-insulation programme. The Energy department website holds an “address eligibility” checker, and I need that information pulled automatically rather than re-typing each location by hand. Your task is to build and run a scraper that goes through the same steps the public tool requires, captures the eligibility result for every address I supply, and returns the full set in a clean Spreadsheet (Excel or CSV is fine). A repeatable script—Python with requests / BeautifulSoup or Selenium, or any language you are comfortable with—is preferred so I can rerun it later when the list of addresses grows. Handle captchas or session cookies if the site uses them, and respect polite crawling speeds to avoid blocking. Deliverables • The complete spreadsheet containing the eligibility outcome for every input address • The scraper’s source code with brief instructions for setup and reuse on Windows or macOS • A short note on any site limitations encountered (rate limits, hidden fields, etc.) and how you worked around them I’ll provide a full batch of addresses as soon as we start. The number will be around 500k. I have attached samples and a description. If you have questions about the site flow, let me know and I can record a quick walkthrough.
Project ID: 40292036
42 proposals
Remote project
Active 1 mo ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

As someone who specializes in streamlining and automating data-driven tasks while ensuring precision, I am confident that I am the perfect fit for your project. With my strong command over Excel, VBA, and web scraping (using Python libraries such as Requests, BeautifulSoup, etc.), I can design a robust and repeatable scraper that captures the address eligibility information from the Energy Department website precisely as required. Having worked on similar projects in the past, I am well-versed with handling captchas and session cookies efficiently, to circumvent any hindrances that may impede uninterrupted scraping. I believe successful delivery of this project lies in meticulous attention to detail and respect for polite crawling speeds to avoid blocking. You can rely on me to honor these requirements throughout the process. Assuring complete organization and reliability in my work, I will provide not only an accurate spreadsheet of eligibility outcomes for all 500k addresses provided but also comprehensive documentation of the scraper's source code for future use. Additionally, I'll include a brief note on any site limitations encountered, how they were worked around to give you full insight into the process. Let me put my expertise to work for you!
$250 NZD in 7 days
5.0
5.0
42 freelancers are bidding on average $478 NZD for this job

Hi, i check ur attached doc and i am ready to start this right now, Thanks...
$750 NZD in 15 days
7.5
7.5

Hello, I have carefully reviewed the project requirements for scraping energy address eligibility and I understand the need to automate the process of checking specific addresses for qualification in the government-funded home-insulation programme. Let's chat and discuss it further. To handle your project, I will start with developing a Python script using the requests and BeautifulSoup libraries to scrape the Energy department website for address eligibility information. I will ensure the script is repeatable and capable of handling captchas or session cookies if necessary. The deliverables for this project will include a complete spreadsheet with eligibility outcomes, the scraper's source code with setup instructions for Windows or macOS, and a summary of any site limitations encountered and how they were addressed. Before signing-off my bid, I would like to ask a question, i.e., could you provide a sample batch of addresses to initiate the scraping process? Best Regards, Aneesa.
$250 NZD in 1 day
6.8
6.8

As an experienced python developer, I have spent the last decade honing my skills in web automation and data extraction, amongst other things. My expertise is a perfect match for your project's requirement- I have successfully completed similar scraping projects where sites employed captchas and session cookies. My ability to adapt to any programming language of your preference places me at an advantage as I can ensure the repeatability you seek. I leverage frameworks like Django, Flask, React, and Anglar to develop cutting-edge solutions. I can understand your need for a clean spreadsheet once all the addresses are processed and you do not want to get into reformatting them again later. Efficiency being my mantra, I guarantee smooth execution even for large batch of addresses which would be your everyday task once we finish initial project run. A project that employs such attention to detail as yours require hands on expertise which I possess and thus I believe am uniquely positioned to deliver optimal results for your scraping task at hand. Let’s connect and explore how we can craft a solution perfect for your needs!
$450 NZD in 1 day
7.2
7.2

Hello, Thank you so much for posting this opportunity. It sounds like a great fit, and I’d love to be part of it! I’ve worked on similar projects before, and I’m confident I can bring real value to your project. I’m passionate about what I do and always aim to deliver work that’s not only high-quality but also makes things easier and smoother for my clients. Feel free to take a quick look at my profile to see some of the work I’ve done in the past. If it feels like a good match, I’d be happy to chat further about your project and how I can help bring it to life. I’m available to get started right away and will give this project my full attention from day one. Let’s connect and see how we can make this a success together! Looking forward to hearing from you soon. With Regards!
$750 NZD in 7 days
6.8
6.8

Hello, I bring over 7 years of experience in Data Processing, Excel, Web Scraping, Data Extraction, Python, and Data Mining. I have carefully reviewed the requirements for scraping energy address eligibility from the government-funded home-insulation program website. To accomplish this task, I propose developing a custom scraper using Python with BeautifulSoup or Selenium to automate the process of checking address eligibility. The scraper will simulate the steps of the public tool, extract the eligibility results for each address provided, and compile the data into a clean spreadsheet format for easy analysis. I will ensure the script is repeatable, allowing you to run it as needed for future address lists. Additionally, I will handle any captchas or session cookies required by the website and adjust crawling speeds to prevent blocking. Upon completion, you will receive the full spreadsheet with eligibility outcomes, the scraper's source code with setup instructions, and a summary of any site limitations encountered and how they were addressed. Let's discuss further details in chat. You can visit my profile at https://www.freelancer.com/u/HiraMahmood4072 Thank you.
$275 NZD in 7 days
6.4
6.4

Hi, We’ve built similar web scrapers that extract data from multiple sources, including real estate listings and job boards. We can create a robust solution that handles multiple addresses and returns results in a clean CSV file. For this project, we’ll use Python with libraries like BeautifulSoup, Selenium, and Pandas. We’ll also implement features to manage proxies and avoid IP blocking, ensuring the scraper runs smoothly. Let’s schedule a 10-minute introductory call to discuss your requirements in more detail and see if I’m the right fit for this project. I’m eager to learn more about your exciting project. Best regards, Adil
$750 NZD in 7 days
6.0
6.0

As an experienced Virtual Assistant and data-processing specialist, I believe I am perfectly suited to handle your project. Over the past 10 years, I have successfully completed over 100 projects that required data entry, analysis, and management. I am also well-versed in advanced MS Office tools such as Excel, which will facilitate the generation of clean spreadsheets as per your requirement. My proficiency isn't just limited to data processing; I am well-skilled in utilizing a wide array of digital applications, including Python with requests/BeautifulSoup technologies that are preferable for this project. This will enable me to grasp and appreciate your specific project needs better than most freelancers. I hold a reputation for providing high-quality and accurate results with prompt delivery, all of which aligns perfectly with your requirements. Rest assured that working with me will offer you excellent communication etiquettes, regular updates, and complete transparency throughout the engagement. Given my skillset and extensive background in managing complex projects across different industries, I-have no doubt that I can efficiently handle your scraping project and deliver the full batch of address eligibility outcomes within stipulated time frames. In fact, the challenge of automating such tasks using a repeatable script is what excites me about this job
$500 NZD in 7 days
5.6
5.6

Hi, I would love to help. I’ve carefully reviewed your requirements, and this is essentially the same type of project I completed two months ago. I am an experienced and specialized freelancer with 6+ years of practical experience in Python, Excel, Web Scraping and I’m able to complete and deliver this project promptly. Feel free to visit my profile to check latest work and feedback from clients. Let us make this great together, please connect in chat. Regards.
$750 NZD in 7 days
5.1
5.1

Hi there yeah I've Read the Project Description and I am sure that I can do this one I am expertise in PYTHON and I can build you a scrapper according to your requirements Kindly send me a message we'll discuss further Really looking forward to hear you Thank you
$500 NZD in 2 days
5.3
5.3

Hi there, I understand you need an automated solution to check a large list of street addresses against the government home‑insulation programme eligibility tool and capture the results without manually entering each address. With a dataset approaching 500k entries, the key is building a stable, repeatable scraper that mimics the website’s address-check workflow while respecting session logic and polite request rates. My approach will begin by analysing the website’s request flow to determine how the eligibility checker processes address inputs, including hidden form parameters, session cookies, or API calls behind the interface. Based on this, I will build a Python-based scraper using requests/BeautifulSoup or Selenium where necessary to accurately replicate the submission process and capture the returned eligibility results. Next, I will structure the script to process large address batches efficiently while implementing throttling, retry logic, and error handling to avoid blocking or data loss. The script will store results progressively and append each address outcome to a structured dataset. Once the run is complete, the results will be exported into a clean spreadsheet (Excel/CSV) aligned with your original address list along with the reusable script with simple setup instructions so you can rerun the process QUESTION: Does the eligibility checker require postcode validation or any multi-step confirmation after submitting the address? Regards, Shehwani.
$250 NZD in 1 day
4.6
4.6

Greetings, I see you're looking to automate the process of checking address eligibility for the home-insulation program. This involves scraping data from the Energy department's website, which can be a bit tedious if done manually, especially with a batch of around 500,000 addresses. To tackle your project, I would create a web scraper using Python, utilizing libraries like BeautifulSoup or Selenium, depending on the site's dynamics. This scraper will mimic the steps needed to check each address, handling any captchas or session cookies along the way. I'll ensure the results are organized neatly into a spreadsheet, making it easy for you to analyze the data. Additionally, I'll document the source code with clear instructions so you can rerun the script as your address list grows. I'll also provide insights on any limitations encountered during the scraping process. Best regards, Mehran Riaz
$300 NZD in 7 days
4.3
4.3

I read your project requirements and would be thrilled to collaborate with you. With expertise in Web Scraping and Data Extraction using Python, I specialize in navigating complex data structures and deliver efficient results and scalable solutions. Let’s connect to discuss further
$510 NZD in 7 days
4.2
4.2

Hi, I can build a reliable scraper to check eligibility for ~500k addresses through the government insulation program checker and return the results in a clean spreadsheet. I have experience automating large-scale data extraction using Python with Selenium/Requests while handling sessions, cookies, and rate limits safely. First, I’ll analyze the site workflow and build a script that replicates the eligibility lookup process. Next, I’ll implement batching, polite crawl delays, and captcha/session handling to process the full address list efficiently. Finally, I’ll export the results to CSV/Excel and provide the reusable script with setup instructions for Windows or macOS. You’ll receive the completed dataset, well-documented source code for reruns, and notes on any site limitations (rate limits, hidden fields, or protections) and how they were handled.
$350 NZD in 4 days
3.5
3.5

Hello, I hope you’re having a great day. I reviewed your project and I would be happy to assist you with your Data Analysis needs. As a professional data analyst, my goal is to transform raw data into clear and meaningful insights that help clients understand their data and make better, data-driven decisions. I can help you clean and organize raw or unstructured data, perform accurate and detailed analysis, identify trends and patterns, and create professional charts, graphs, and dashboards. I will also provide a clear, well-structured report with actionable insights so that the results are easy to understand and useful for decision-making. I have experience working with tools such as Microsoft Excel, Google Sheets, Python, and Power BI, which allow me to analyze data efficiently and present the results in a professional and easy-to-understand format. I always focus on delivering high-quality and accurate work, maintaining clear communication with clients, ensuring fast and on-time delivery, and providing complete client satisfaction. I would love to learn more about your project. Could you please share the dataset and let me know what type of analysis or insights you are looking for? Once I review the details, I can start working immediately and deliver the results as quickly and accurately as possible. Thank you for your time and consideration. I look forward to working with you. Best regards,
$250 NZD in 2 days
3.8
3.8

I specialize in developing high-performance scrapers for government eligibility portals and lead qualification systems. Recently, I completed a similar project for an energy consultancy where I automated the verification of thousands of addresses against insulation scheme criteria, drastically reducing their manual audit time. I understand that accuracy is paramount here, as false positives can lead to wasted resources in your installation pipeline. My goal is to deliver a reliable, repeatable solution that ensures your data is 100% compliant with the government’s specific qualification requirements. I will deploy a Python-based automation script using Playwright or Selenium to navigate the portal and simulate human interaction. If the site employs bot detection, I’ll integrate a CAPTCHA solver or residential proxies to maintain high throughput. I will structure the final output as a clean CSV or Google Sheet, including timestamped verification proofs and eligibility codes. The script will include error-handling logic to manage site downtime or formatting inconsistencies in your input list, ensuring no address is missed during the process and providing you with a clean, actionable dataset. Do you have a preferred input format, and are there specific "partial match" scenarios we should flag for manual review? I’m also curious about your target volume, as we can scale the scraper using concurrent threads if speed is your priority. I'm available for a quick chat to discuss the portal's specific nuances and align on the data schema. Looking forward to helping you streamline this verification process and scale your energy leads efficiently.
$750 NZD in 21 days
3.0
3.0

Hope you are doing well! Lets start! Your project requires building a reliable scraper to automate the address eligibility check process and return results for a large dataset of around 500k addresses. Potential challenges include handling session cookies, hidden form fields, possible captcha triggers, and avoiding rate limits while maintaining stable performance during large-scale scraping. Previous experience includes building high-volume scraping systems using Python with requests, BeautifulSoup, and Selenium where similar issues like dynamic forms, session validation, and blocking protections were resolved by simulating real browser requests, implementing queue-based batching, and adding polite delays with retry logic. Large datasets were processed with structured logging and checkpoint saving to prevent data loss during long runs, ensuring clean CSV or Excel outputs ready for analysis. Delivered solutions included reusable scripts with clear setup instructions for Windows and macOS, along with documentation describing site behavior, rate limits, and implemented workarounds. I know what do I build for you, can complete it to your full satisfaction within your timeline. I am ready for you and waiting here. Thank you.
$300 NZD in 7 days
3.0
3.0

Hi, I see you need an automated scraper to check energy address eligibility from a government site without manually typing each address. I understand you want a repeatable script that handles up to 500,000 addresses and outputs results into a clean spreadsheet. Your project requires navigating the eligibility checker, handling potential captchas or session cookies, and respecting polite crawling speeds to avoid blocks. You also want the scraper’s source code with setup instructions for Windows or macOS, plus notes on any site limitations encountered. I have built similar Python scrapers using Selenium to automate form submissions and BeautifulSoup for parsing results, delivering clean CSV outputs. For example, I created a scraper that handled dynamic session cookies and captchas with built-in delays to prevent IP blocking, which aligns well with your needs here. I can complete the scraper and deliver all materials within 10 days of starting. Feel free to share the address samples or a walkthrough so I can clarify any site-specific details before beginning.
$275 NZD in 7 days
2.8
2.8

Hello, With my wide range of skills in data extraction, mining, and processing, along with my proficiency in Excel and Python, I am confident that I am the right person to handle your project. Having previously worked on similar projects involving web scraping using tools such as BeautifulSoup and Selenium, I am well-versed in building automated scrapers which can process large amounts of data reliably and efficiently. Many tasks I performed explicitly required scraping through governmental resources like websites. Additionally, capacity to adapt and quickly learn new things has allowed me to proficiently navigate around common obstacles encountered during scraping like captchas, logging in with session cookies and handling hidden fields. My aim is to automate such processes that save not only your time but also give you accurate results. Lastly, I want you to know that I don't just complete project tasks; I create long-standing professional relationships. If you give me a chance on this project, not only will you receive a clean spreadsheet of all the eligible addresses but also detailed scripts with simple setup instructions. With this script, you'll be able to execute future address evaluations independently—no need for re-hiring.
$250 NZD in 7 days
2.9
2.9

Hi there! I'm Craig, I've been working with similar projects like this one for years and I can say without hesitation that there's hardly any task as fitting to my skill set as this one. With my expertise in data mining and processing and especially in Web Scraping, I have developed the proficiency required to scrape websites at scale while ensuring accuracy and efficiency, which is critical given the huge number of addresses we are expecting in this project. My preferred language for this kind of task is Python utilizing the requests / BeautifulSoup or Selenium libraries as mentioned in the project description. However, I'm quite comfortable using other languages such as PHP, Node.js, C# too if that better suits your infrastructural choices. Besides providing the deliverables -a comprehensive spreadsheet with eligibility data, documented source code, and a guide to help you employ the code by yourself - I will also include a short note on any site limitations encountered during scraping (rate limits, hidden fields etc.) and my strategies to work around them. Ultimately, what really sets me apart apart from others is not just my technical capability but how good I am at fully understanding client needs. Be it respecting polite crawling speeds or being adaptable enough to rerun scraping scripts over time, rest assured that your project will be completed to your utmost satisfaction. Let's get started on this venture together- you won't regret choosing me!
$500 NZD in 7 days
2.5
2.5

Hello, I can build a **reliable, repeatable scraper** to automatically check address eligibility through the government website and process your full dataset of ~500,000 addresses efficiently. I have extensive experience with **Python-based scraping using requests, BeautifulSoup, and Selenium**, including handling **session cookies, dynamic forms, captchas, and rate‑limited sites** while maintaining polite crawl speeds to avoid blocking. My approach will replicate the exact steps used by the public eligibility checker, capture the result for each address, and export everything into a **clean Excel/CSV dataset**. I will also structure the script so it can **run in batches and resume safely**, which is important for large datasets like this. Deliverables will include: • The **complete spreadsheet with eligibility results** for all addresses • **Reusable Python scraper source code** with setup instructions for Windows/macOS • A **short technical note** explaining any site restrictions, rate limits, or workarounds used I can start immediately and ensure the script is **stable, scalable, and easy for you to run again** as your address list grows.
$500 NZD in 7 days
2.5
2.5

Auckland, New Zealand
Payment method verified
Member since Jan 22, 2014
$3-10 NZD / hour
$250 NZD
$20-30 NZD / hour
$65 NZD
$250-750 NZD
₹750-1250 INR / hour
$15-25 USD / hour
₹400-750 INR / hour
₹750-1250 INR / hour
£10-15 GBP / hour
€8-30 EUR
₹600-1500 INR
₹100-101 INR / hour
$15-25 USD / hour
$75-150 USD
$750-1500 AUD
₹600-1500 INR
$10-30 USD
$30-250 USD
$200-350 USD
€8-20 EUR
₹12500-37500 INR
₹750-1250 INR / hour
₹600-1500 INR
₹600-1500 INR