Tanmai M. Profile

MENJELAJAH

0.0

(0 ulasan)

Anda kini mengikuti

Ralat mengikuti pengguna.

Pengguna ini tidak membenarkan pengguna untuk mengikuti mereka.

Anda telah mengikuti pengguna ini.

Pelan keahlian anda hanya membenarkan 0 mengikuti. Naik taraf di sini.

Berjaya menyahikut

Ralat tidak mengikuti pengguna.

Anda berjaya mengesyorkan

Ralat mengesyorkan pengguna.

Sesuatu telah berlaku. Sila segar semula halaman dan cuba lagi.

E-mel berjaya disahkan.

$10 USD / jam

noida,

india

$10 USD / jam

Sekarang jam 9:36 PG di sini

Menyertai Mei 23, 2015

0 Cadangan

Tanmai M.

@Tanmai1208

0.0

(0 ulasan)

0.0

$10 USD / jam

noida,

india

$10 USD / jam

N/A

Pekerjaan Disiapkan

N/A

Mengikut Bajet

N/A

Tepat Pada Masa

N/A

Kadar Upah Semula

PLSQL and ETL Developer

Developing data pipelines for extraction, transformation and loading data from multiple sources like Amazon S3, Oracle and flat files. Enhancing python scripts for dataset onboarding and automating file validation to maintain data integrity. Analyzing Kafka logs on CloudWatch to identify and troubleshoot job failures. Developed Pyspark scripts to perform data transformation, creating DataFrames and running Spark SQL. Creation of ETL pipeline for fetching data from multiple sources. Used Pyspark to load complex JSON and performed data cleansing activities on it.

Lihat semua Python Developers dalam India

Hubungi Tanmai M. tentang pekerjaan anda

Log masuk untuk membincangkan sebarang butiran melalui sembang.

Ulasan

Perubahan disimpan

Tiada ulasan untuk dilihat di sini!

Pengalaman

Cians Analytics

Jul 2019 - Jul 2020 (1 tahun)

Developed Ingestion, Validation and Monitoring Framework using Python/PostgreSQL for generating rules, validating those and monitoring the file before uploading them into the system. Working on ETL pipeline creation using pyspark from multiple data source like S3, Redshift, FTP servers and other cloud platform. Implemented Spark using python and SparkSQL for faster testing and processing of data. Imported data from AWS S3 into Spark RDD and performed transformation and action on RDD’s.

Tata Consultancy Services

Jul 2016 - Jul 2019 (3 tahun)

Designing and creating the system for US Based Client from scratch which involved streaming data from edge remote machines to processing that data on cloud. Creation of multiple python ETL scripts from Informatica mapping and also developed Informatica workflows from scratch. Worked and learned great deal from AWS Cloud services like EC2, S3, VPC, Lambda, EBS. Used Spark-SQL to load JSON data and create schema dataframe and loaded it into hive tables and handled structured data using SparkSQL