I am working on a platform that runs a Django/Postgres backend with a React frontend. The platform scrapes data from multiple sources with Scrapy, cross-relates them, and gives some basic analysis of them via the front-end and HighCharts.
I am running into some issues with scaling the platform and some strange issues getting the entire system to work together. For example, running Scrapy & Twisted on a worker server has been problematic at times and I am having issues using Python multi-processing in tandem with the Django ORM (objects appear to be created randomly).
10 pekerja bebas membida secara purata $136 untuk pekerjaan ini
Hello. I have specialized in web scraping using python/Django, scrapy, selenium, beautifulsoup, etc. Especially, I have experience in fixing above issues at before time. I can help you. Thanks, Irina.