
Cancelled
Posted
Paid on delivery
Hello! Thank you for having interest in this topic. The title might be very strange, but it has actual purpose. If you ever have experience running a web crawler/scraper, I guess that you'd meet one common dillema. It's about speed of the crawler. Just running a single instance of script, something takes around days to complete its scraping job. or even more than days. perhaps weeks, even months. in case of running single instance scraper. to compensate this deficiency most of cases we choose to setup multiple instances of crawler. But then even using that method, there's certain limitation. Especially when you're one single person with one single hardware computer, The multiple instances are meant to be restricted according to the computer's specs. About what type of GPU it is, and how many rams it has. To go beyond that limit, I've come across a thinking that maybe, I could be using cloud computers. and run the crawlers instances in that multiple cloud computer. I've posted something similar already in the past. Please look behind pastebin the link. [login to view URL] (Please take a look) But so far, I only had the idea and never have seen if it's possible. So I need actual specific, detailed demonstration for it. The title as you see it's saying about running billions of crawlers. But to be really honest I don't need that. But I need to absorb 'actual happening' and how it could be done. I'm 100% sure that there must be a way that is able to run Billions of Crawlers. I'm good even if it's not Cloud computer based method, But if you have seen a single case of it, I expect you'd have the knowledge how it's getting done. That is the knowledge share I am expecting in this topic. [login to view URL] [login to view URL] ^ Related articles worth to take a look :) Question 1. Let's say we have 3 instances running in the cloud computing service. (as Windows os) each is named as instance 1, instance 2, instance 3 and then let's say we have a very simple Python script. that opening a notepad in Windows, and type words in it. And then, We should have set-up those python scripts inside of all these 3 instances, Can we have overviewing script that deciding to write '123' in instance 1, and '456' in instance 2, '789' in instance 3? Hopefully not entering in each of the instance and fixing the script one by one, just overviewing in one script. Would it be possible in Cloud Computing Service? Question 2. If you have the knowledge, please let me know which program languages are most used when it comes to this parallel work way combined Cloud Computers. Essential Note 1. please record your screen show-casing all the answers of the question above. To demonstrate your answer. I would be appreciated if this could be recorded as if it's a tutorial. :) Thank you for reading! Have a good day and bid me if you think you can complete one. Anytime ! And I am willing to respond very quickly to explain and describe more what I exactly need. also, if you can really make it out well this time in this project, I will promise to carry out further projects with you. Thanks alot.
Project ID: 19439072
7 proposals
Remote project
Active 7 yrs ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
7 freelancers are bidding on average $411 USD for this job

Hello How are you My name is Xu agree 100 i have full time and I can start to work immediately Please contact me and do let us discuss about your project Thanks for your posting
$250 USD in 10 days
7.2
7.2

Hello there, This is a default bid made. we'll discuss the price later in the chat after reading your project i can do this for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss this further.. Thanks . .
$555 USD in 3 days
6.1
6.1

Hi, I looked at your description carefully and I am very interested in providing my skills in hopes of working with you. I have ample experience in web scraping. -scrap any website using selenium, beautifulSoup, request and etc in python. -save data scraped into xlsx, csv, mysql and etc using xlsxwriter and csv. -create bots and website replica. I have just completed the same project. Please feel free to contact me if you have any further questions. I look forward to hearing back from you. Thank you!
$250 USD in 2 days
6.0
6.0

Data Mining, PHP, Python, Software Architecture, Web Scraping skilled professional with the required expertise. Can help to deliver the solution as needed on the expected lines. Please private message me to discuss the project further. Hope to build a long term business relationship. Thanks!
$666 USD in 10 days
5.4
5.4

Hi dear,I am a senior web and software developer. I've just checked your post. I can complete your project in timely manner and you'll feel free while working with me. Please contact me to discuss more over chat for your project. I am confident of your project - web scraping expert budget=$100 My best Skills are Data Mining, Python, Web Scraping, PHP, Software Architecture and so on.
$555 USD in 3 days
5.0
5.0

web scrapping expert budget High Quality + Fast Speed = Excellent Result + Business Success, this is my working style. I have gone through your Job post and I can understand your job requirement thoroughly. I have a total of 15 years of experience in Web Designing and Development and had completed a number of projects with some great graphics and User Interface so far. I have all the required skills and experience you need for the above Job. I have strong command over: * WordPress, PHP, Wordpress themeing, Plugin Development * Android and IOS all kind of mobile apps development *Responsive theme Design * HTML5, CSS3 , Jquery, Bootsrtap, Git, * Widget Development * Other CMS: Magento, Joomla, Expression Engine, Drupal etc. * I’m honest & trustworthy, dependable & fast learner. * I’ve over 7 years experience in Wordpress Website designing/development. * I am available 40 hours a week for your job. You can be assured of a quality communication and the quality of the work provided from my end. I’m looking forward to hearing from you soon. Thank you for considering my cover letter.
$325 USD in 10 days
5.3
5.3

Los Angeles, United States
Member since May 4, 2019
$8-15 USD / hour
$10-30 USD
₹600-1500 INR
₹1500-12500 INR
$250-750 AUD
$10-30 USD
₹1500-12500 INR
₹1500-12500 INR
₹1500-12500 INR
₹12500-37500 INR
$1500-3000 USD
$30-250 AUD
₹12500-37500 INR
₹12500-37500 INR
€30-250 EUR
$15-25 AUD / hour
$8-15 USD / hour
₹600-3000 INR
$30-250 USD
$10-30 USD
₹12500-37500 INR