Docker - Multi-Thread crawling- Microsoft Azure-AWS-Google Cloud-- Expert (100$) -- 9

Hello. thank you for having interest in this topic.

*Please read description first thoroughly, if you're copy-pasting meaningless words I will instantly dump the proposal. Thank you *

If you have experience in scraping/cralwing work, You know there's a capacity which one scraper one thread can be running.

And in order to compensate this problem , we often adopt multi-threaded system inside of the script, But even when adopting this, We could be still having the same problem.

This is why most of crawlers end up with using Cloud computer/servers , setting multiple virtual computer(server,cloud), setting multi-threaded script inside.

Not necessarily to explain long about this, If you have experience, You'd definitely understand what I'm saying.

I'm here to find decent future co-worker who has related skills to setup such environment and have experience to setup and build such models.

Project price 100$ is related with the right next project we're going to jump on, that I will inform you through DM. (Direct message) or sending official offer.

but beforehand, let me ask you questions.

1) Do you have experience multiple server/cloud/VM based scraping work?

2) If you have answers yes to 1), Could you show me a simple demonstration video about how it gets to be run? (No need to show script or inside-tricks, just on surface, simply the scenes that should be enough to prove it's working)

3) Did you also have experience with proxy-rotation adoptation?

Please fill in the form with sending proposal. If our communication is not in exact form, We can not proceed any further. and I will kindly reject it all once it's not in the question form. Thank you.

Kemahiran: Aws Lambda, Azure, Pengkomputeran Awan, Docker, Pelayan Microsoft SQL

Lihat lagi: winsockets multi thread, multi thread vb6, multi thread socket programming atm machine java code, multi thread ping, multi thread console, web multi thread, multi thread web scrape, winsock multi thread, resume delphi software multi thread ado php, multi thread ajax aspnet, multi thread visual basic 2008 application, microsoft access vba google maps, Multi thread, win sock multi thread, microsoft access linking google maps, crawler multi thread java, php scrape google multi thread, multi thread google scraper, aws sqs multi thread

Tentang Majikan:
( 13 ulasan ) Incheon, Korea, Republic of

ID Projek: #21046476

Dianugerahkan kepada:


G'day, mate. very interesting project, i have fair bit of exp of crawling using .net & Azure Cloud. Q1: Yes. I used a few Azure vms to run console app (its written in c#, not messy scripts) plus a SQL Server DB as bac Lagi

$170 USD dalam 7 hari
(0 Ulasan)

4 pekerja bebas membida secara purata $175 untuk pekerjaan ini


Can do this I have the required skills over here guys i have a team that will work on your issues carefully and make changes as per your requirement. With my experience, I hope to receive an offer from [login to view URL]

$250 USD dalam 8 hari
(0 Ulasan)

Hello. How are you? I have read your requirements carefully and understood what you want. I can finish your project for short days perfectly because my skill is very suitable for your project. Mainly, I like friendly w Lagi

$140 USD dalam 7 hari
(0 Ulasan)

I am expertise in the Docker. And I also have the knowledge of AWS . I have 2 years of experience in docker.

$140 USD dalam 7 hari
(0 Ulasan)