Hello,
I have gone through your requirements regarding support for Spark, Scala , SQL, Linux based Hadoop ecosystem & web services Autosys & will definitely help you for your requirements as I have 6+ years of experience in Big Data.
I have hands-on expertise in different components of Hadoop:-
-Hive
-Oozi
-ETL
-Spark
-Sqoop
-Impala
-Pig
-Flume
-Kafka
-Ranger
-Kerberos
-Ldap
-Scala
-Sentry
etc
-----------------------------------------------------------------
I also possess strong proficiency in Unix shell scripting, orchestration layer Autosys & also have a great expertise in AWS & it's different services including Redshift, Dynamo DB, etc.
-----------------------------------------------------------------
Type of BIG DATA projects I have worked upon :-
-Created ETL pipeline to handle big data applications and data set
-Worked on migration projects for big data applications
-Remediated Big Data applications to make it more secure and parameterized
-Built Data lake on Hadoop by integrating different data sources
etc
-----------------------------------------------------------------
Awaiting your kind response to discuss your project in detail
Thanks