I have a system with a few scrappers. Scrappers are scrapping data from different websites and storing data on MongoDB and then data shows on my website from there.
In the last few days, I am not seeing any new data on my website. Partial data are being updated properly.
I want an expert who can see the scrape log and also check the DB to find the issue and fix it. This problem happened in the past also and my previous developer was fixed that easily. Unfortunately, that developer is not available right now and I also forgot the reason for the problem.
My website is hosted on an Ubuntu server (Nginx).