Pyspark job - 1000 gz files with 1m json objs of 6KB each to 1B files in s3

₹600-1500 INR

Dalam Kemajuan

Disiarkan

lebih dari 2 tahun yang lalu

₹600-1500 INR

Dibayar semasa penghantaran

Hi, I need help to execute a pyspark job. I need to process them. I have 1000 gz files with 1m json objs of 6KB each which we need to convert to 1B json files and save in s3

PySpark

ID Projek: 32284277

Tentang projek

2 cadangan

Projek jarak jauh

Aktif 2 tahun yang lalu

Ingin menjana wang?

Alamat e-mel

Faedah membida di Freelancer

Tetapkan bajet dan garis masa anda

Dapatkan bayaran untuk kerja anda

Tuliskan cadangan anda

Ianya percuma untuk mendaftar dan membida pekerjaan

Dianugerahkan kepada:

@ashishdudeja1994

I have done work in pyspark extensively. Alternatively we can use multithreading or multiprocessing also in python to achieve this. Let me know. I am really interested in this job. I am currently working as a Senior Data Engineer in an IT Company. I'm offering best quality and highest performance at a price we are both comfortable with. I can complete your project on time and your will experience great satisfaction with me. I'm well versed in Python,SQL,Unix Scripting, Excel VBA etc I have rich experienced in Word, PDF, Data Processing, Data Entry, Web Scraping. For more information about me, please refer to my portfolios. I'm ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details Thank you! Ashish Dudeja

₹1,300 INR dalam 7 hari