Ditutup

Scrape ArcGIS Rest Map Server into PostGIS database using Python

This is an initial project to pull data from multiple ArcGIS Rest API servers from multiple municipalities. There is very good potential for this project to expand into long-term work. If the project is successful, we will look to add 100 more server APIs to this program and the Upwork contractor would be the go-to vendor list for other data automation, aggregation work in the future including the expansion of these projects into the United States.

Detailed step by step solutions and specifications will be provided upon request.

1. Looking to scrape multiple map layers from a public ArcMap REST server that is available for free in the public domain. There are multiple types of Github scrapers using Python available to quickly scrape these REST services. We're looking to then push these geospatial datasets into a PostGIS 2.X table with geospatial/geometry and table attributes

2. This would be to automatically run a scrape of multiple public ArcGIS Rest servers using raw Python or Django framework that will be loaded into a PostGIS + PostGreSQL database on a weekly basis. The backend program needs run on a Linux cloud server environment, able to scale and take calls to multiple different ArcGIS servers in different cities and regions including Geocortex middleware or sites with tokens.

3. Example ArcGIS Rest Server scrapes:

Toronto Heritage

[login to view URL]

Vaughan Zoning Online Map

[login to view URL]

Markham Zoning Map

[login to view URL]

Note: This may be more complicated as it has a Geocortex overview with a login and password for REST API access directly: [login to view URL]

Kemahiran: Python, Pengikisan Web, Geospatial, Perlombongan Data, Kejuruteraan

Lihat lagi: plot map points database using, use google maps map addresses database using aspnet, insert screen scrape data sql database using, wpf client server database using wcf, update database using rest service, update database using rest services, change database server crystal report using vb6, attach sql server database using, copy mysql database from one server to another using workbench, how to sync local mysql database and live server database using php, connect to oracle database using python, how to insert image in mysql database using python, how to connect html page to mysql database using python, how to store data in database using python, how to connect html form to mysql database using python, backup and restore sql server database using asp net, connect html page to sql server database using javascript, connect to remote oracle database using python

Tentang Majikan:
( 13 ulasan ) yanji, China

ID Projek: #22082858

9 pekerja bebas membida secara purata $153 untuk pekerjaan ini

schoudhary1553

Hello Sir, I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without cha Lagi

$250 USD dalam 4 hari
(47 Ulasan)
6.4
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON Lagi

$100 USD dalam 3 hari
(74 Ulasan)
5.5
zeke

I have done many similar projects related to web scraping information from different websites. Very interested to work on this project. I am absolutely confident I can finish this work on time and on budget to highest Lagi

$100 USD dalam 5 hari
(41 Ulasan)
5.8
retxxxirt

Hello. I carefully read your requirements and viewed attached links. I understood what kind of queries should to be requested for each layer to get all its data, but I had a few questions about how it would be saved in Lagi

$150 USD dalam 3 hari
(10 Ulasan)
4.0
Lagripe

Hi. I am a freelancer working in 24/7 service. I have much experience for 6+ years in Scraping Field, I can do your job with Python or C#. I will produce the output in any format you desire. I think this project is for Lagi

$120 USD dalam 3 hari
(7 Ulasan)
3.3
zymerconstantine

Dear Hiring Manager, After reviewing your job description, it’s clear that you’re looking for a candidate that is extremely familiar with the responsibilities associated with the role, and can perform them confidently Lagi

$125 USD dalam 7 hari
(1 Ulasan)
1.2
shahzaibpro

I am a Full-Time Freelance Full Stack Web App Developer-Designer (Specialising in CRM, Laravel, ERP, E-commerce, Website Developing & Designing, Android Apps, Ios Apps, web-apps). I am also proficient in the following Lagi

$140 USD dalam 7 hari
(0 Ulasan)
0.0
anviverma111

HI I am experienced in [login to view URL] [login to view URL] Lagi

$140 USD dalam 7 hari
(0 Ulasan)
0.0
amrindersingh84

Dear concern, With a background that includes five years of Python-Django programming in a high-volume transaction environment, I'm very interested to develop this application in Django-Python. I have read the job de Lagi

$250 USD dalam 7 hari
(0 Ulasan)
0.0