well let me inform you what i am doing and what we want to be done in one week because i am short in time..i have a travel agency site, that makes packages by scrapping airlines through puppeter and api from hotels. So scraping airlines with this tech is something that i want the developer to know. i want to change the way that my packages are done. instead of calling the same information all the time, i want to build one kind of filter database that will first take the info of the airlines that it will scrap, and if it finds the same airports and date, to delete this call to the airline, so that it will store for 15 minutes into a database the prices of one time search from that "cached" price i want my packages to be made instead of the direct call of the airline.
So in short
1) there will be a call of all the flights/dates/airports to this filter
2) This filter will delete the duplicate calls and it will call only one time the airline
3) The scraped info will be stored into a database that will be stored there for 15 minutes...
4)After 15 minutes this info will be deleted
from that database my system will create the packages
i need that delivered by 27 of January
1)Build a .NET API regarding to your current Puppeteer.
2)DB creation and integration to store Filter params so that there will be no duplicate searches of the same flight caracteristics)
3)Integration to your current website of wordpress
My project cannot exceed the 400 usd.
15 pekerja bebas membida secara purata $592 untuk pekerjaan ini
Hello, I am very good at web scraping and network automation tasks. I can scrape almost any website wether it applied anti-scraping mechanism nor not. I hope you can choose me.