Hadoop Jobs

I am looking for an experienced AWS developer to migrate my AWS Glue ETL Jobs along with Glue workflow to another AWS environment. i also want to migrate s3 bucket folders as well. the iDea is that i have an aws environment in which i have put files on s3 and using AWS glue to load data from it and load back into s3 itself. i want a way to migrate this solution into another aws environment via cloud formation or other mechanism Requirements: - Strong experience with AWS Glue and ETL Jobs - In-depth knowledge of AWS environments and their capabilities - Ability to migrate ETL jobs within a short timeline (1-2 days) The ideal candidate should have experience in AWS migration projects and be able to provide recommendations on the best AWS environment to migrate the ETL jobs to. Additionally...

I am looking for a Spark Scala developer with intermediate experience to assist with data processing and analysis. The specific tasks for this project include building machine learning models and developing Spark applications. There is no specific deadline for the project, allowing for flexibility in completing the tasks. The ideal candidate should have intermediate experience in Spark Scala development and be proficient in data processing and analysis techniques.

I am looking for a freelancer who can help me with a Cloud-based data virtualization solution. I have a rough idea of the software I want to use, but I am open to suggestions. Ideally, the freelancer should have experience with the following: - Cloud-based data virtualization - Knowledge of Denodo, Cisco Data Virtualization, or Red Hat JBoss Data Virtualization - Proficiency in Excel and Python The main goal of this project is to create a data virtualization solution that meets my specific requirements. I am looking for someone who can help me optimize my data management processes and ensure seamless integration with my existing systems.

I am looking for a Kafka Admin who can assist me with the following tasks: - Onboarding Kafka cluster - Managing Kafka topics and partitions - Its already available in the company and we need to onboard it for our project . -Should be able to Size and scope . - We will start with small data ingestion from Hadoop datalake . -Should be willing to work on remote machine . The ideal candidate should have experience in: - Setting up and configuring Kafka clusters - Managing Kafka topics and partitions - Troubleshooting Kafka performance issues The client already has all the necessary hardware and software for the Kafka cluster setup.

Over the past years, I have devoted myself to a project involving Algorithmic Trading. My system leverages only pricing and volume data at market closing. It studies technical indicators for every stock in the S&P 500 from its IPO date, testing all possible indicator 'settings', as I prefer to call them. This process uncovers microscopic signals that suggest beneficial buying at market close and selling at the next day's close. Any signal with a p-value below 0.01 is added to my portfolio. Following this, the system removes correlated signals to prevent duplication. A Bayesian ranking of signals is calculated, and correlated signals with a lower rank are eliminated. The result is a daily optimized portfolio of buy/sell signals. This system, primarily built with numpy...

Location specific - Denver (USA) Data Engineer - Job Description Overview: We need an experienced Data Engineer to join our team working on an impactful project applying Artificial Intelligence for better monitoring and root cause analysis of our Sling service delivery. You will build and maintain the critical data pipelines that feed our AI models and analytics. In this role, you will ingest data from our content workflow systems, CDNs, AWS services etc. and transform it into a reliable, analytics-ready dataset. You will need strong hands-on experience with data pipelines, ETL, and data processing frameworks. This project offers exciting opportunities to apply your data skills to have a real business impact. Our AI models rely on clean, unified data to detect anomalies and enable...

I am looking for a Hadoop developer with a strong background in data analysis. The scope of the project involves analyzing and interpreting data using Hadoop. The ideal candidate should have experience in Hadoop data analysis and be able to work on the project within a timeline of less than 1 month.

I am looking for a Hadoop developer with a strong background in data analysis. The scope of the project involves analyzing and interpreting data using Hadoop. The ideal candidate should have experience in Hadoop data analysis and be able to work on the project within a timeline of less than 1 month.