Python Data Scraping


I have a python code to scrape a website and analyze it. There is an option to top up the incremental changes if needed. Right now it uses a single process to fetch the data. I have used selenium and bs4 for it. I need an expert to optimize it, structure the code properly and use multithreading / parallel processing to fetch the data in lesser time. The website throws error if there are multiple requests in a very less time, so there is a need to bypass that as well. Currently, the bottleneck is that we can send a single request every second to that website. Website is [login to view URL]

After the optimization, we need you to host it on heroku or any optimal cloud platform and program it to run at times according to certain data points that are to be fetched from another part of the website. Some part of the code has to be parameterized so that we can change some parameters from the heroku terminal directly. The fetched data has to be saved on a set folder in Microsoft Onedrive.

Kemahiran: Data Scraping, Pengikisan Web, Scrapy, Python

Lihat lagi: python data scrape, Python data scraping, data scraping websites python, python data scrape code, data scraping ajax python, mysql data scraping python, python sports data scraping, title:(QA OR Test OR Testing OR BA OR QC OR automation OR Python OR Scraping OR Scrapy OR Data), QA OR Test OR Testing OR BA OR QC OR automation OR Python OR Scraping OR Scrapy OR Data, data scraping using python, scrape data from website python, web scraping for data science with python pdf, web scraping with python: collecting data from the modern web, python web scraping real estate data, data scraping tools python, web scraping with python scrape data from any website with the power of python richard lawson

Tentang Majikan:
( 0 ulasan ) Indore, India

ID Projek: #30124649

6 pekerja bebas membida secara purata ₹8833 untuk pekerjaan ini


Hi! I'm 5 years experienced Data Scientist with theoretical and practical experience in Data Science, Machine Learning & Deep Learning ready to do your work in an efficient way with strong analytical and logical reason Lagi

₹12000 INR dalam 2 hari
(4 Ulasan)

Hi Dear Employer, At first take my respect. I am python programmer backgrounder. I read your project description. I understand you want help regarding Python Web Scraping Scrapy Data Scraping Please leave me on mass Lagi

₹9000 INR dalam 7 hari
(2 Ulasan)

I'm a Machine Learning Student & projects gives me alot of practice in long run. Reference Projects, GitLink : [login to view URL] Stack usage: 1. Language : Python 2. Tools : Tensorflow, OpenCV, Kera Lagi

₹7000 INR dalam 7 hari
(0 Ulasan)

I can give you a week of my work per 10000INR(+120USD). Contact if you want. Hi, my name is Miqueas Aguirre. I am fullstack developer(1+ year) with: FRONTEND: 1. Angular 2. Vanilla JS 3. Bulma 4. HTML/CSS/Less BA Lagi

₹10000 INR dalam 7 hari
(0 Ulasan)

I am a Web developer and web scrapping expert. I had 4 year experienced in this field. I can do your project in cheap price with high quality. Please response me as soon as possible.

₹7000 INR dalam 7 hari
(0 Ulasan)

- previous experience in such topics; - eager to discuss a lot in this chat stream; - degree stats / maths;

₹8000 INR dalam 3 hari
(0 Ulasan)