ETL/data engineering for Python web app
Bajet $25-50 USD / jam
Looking to have a pipeline to retrieve data via API call from data source, transform the data, and load into BigQuery on GCP.
What we are doing:
Building a web app that combines features (ie. data fields) from many different sources for many different records. For example, there are over 600 records and each record has tens of data fields from various data sources. The data will be combined into a single, rank-ordered list based on user input. For example, there will be a static list of features (ie. data fields) from various sources (eg. US Census, FBI crime data, NOAA weather, etc) and the user will fill out a questionnaire. Based on the input from the questionnaire, the static data will be scored and combined into a single number.
What we need from you:
- Write the code to data from source via API call for each record
- Adjust the data (ie. clean, impute missing, and transform)
- Load the data into BigQuery
This pipeline will be run one time per year. However, the pipeline will need to pull a lot of data (5-15 features for more than 600 records).
This projects is to build a pipeline for a single source. Based on the quality that is delivered, additional pipelines for other sources can be contracted.
The pipeline needs to written in Python and must be deployed on GCP.
57 pekerja bebas membida secara purata $38/jam untuk pekerjaan ini
Hi there! I have read what you exactly need and I have great experience with Software Development, ETL, Google Cloud Platform, Python and API. However I would like to ask you a few questions. I do work smart and do not Lagi
* * * * * * * * * * * * * * * * * * * * * * Hello Joe , I’m a Professional and Expert Python Developer. I am interested in doing this job for you.I do have the necessary skill set & resources to complete this project. Lagi
Hi, I have read your post and understood your requirement. Looking for the freelancer to work on your next project? Or just need some issues/bugs/fixes ASAP? I have 11+ years of software experience in fortune 500 com Lagi
Hello, How are you? I read your job post, and I am interested to work with you on this project, as I have relevant skills set, you can check my profile for your surety. Rest we will finalize everything after complete Lagi
Hi there, ★★★ Python Expert ★★★ 5+ Years of Experience ★★★ I've read requirements and ready to retrieve data via API call from data source, transform the data, and load into BigQuery on GCP.. My skills and services: ✔ Lagi
Hello I understood your requirements but I have a few doubts, text me so I can clear all my doubts right away
Hi, there. I am an experienced web developer and have previously worked on several GCP applications, so I will provide you quality work according to your instructions. Please contact me so we can discuss in more detail Lagi
Hello there, Thanks for your job posting and I am interested in your project. I have an excellent background as a Data Engineering and Data Science Expert, have rich experiences with ETL, ELT in python. I would like t Lagi
