I am BigData engineer with vast experience in various tools like spark(pyspark), Hadoop, yarn, Hive, kafka and Python, shell scripting. Have good experience in designing and implementing ETL pipelines using pyspark with source and destinations being S3, Hive, Mysql, Kafka and Redshift. Will be able to handle huge datasets and different data transformations.