IB schools query result
Sample of a scrape job for http://www.ibo.org/programmes/find-an-ib-school/. This job was very interesting because much of the data was hidden behind an ajax call (load more button). I automated the script to keep on clicking the button to expose all of the data that fits search criteria until the button no longer shows in the browser DOM, then immediately collect the information.
Tentang Saya
Allow me to meet data needs for your business. Whether you need data extraction from multiple sources, such as websites or APIs or need a scraping solution to run periodically in-house, I have you covered. I also excel at creating automated web processes (e.g.. instruct a browser to do tasks A-Z, then relay the output to a database or email). With deep roots in web development I can get exactly what you need. Your business is my business. Here's just some of my services: • Scrape big data from directories, tables, search forms, APIs, websites requiring authentication, websites with dynamic pages with javascript rendering, etc into various formats including CSV/JSON/TSV/XML/Excel. • Write custom scraping solutions ready for deployment • Integrate relational databases into scraping applications • Building sportsbooks odds aggregation app to find and notify value bets and arbitrage opportunities Please feel free to inquire about other general web development.
