Hadoop Jobs

1. Develop/Propose various ETL pipelines for the combination of hadoop eco-system with/NOT spark using AWS cluster; 2. Implement the multi-purpose ELT pipeline (like kappa or lambda architecture) that ingress data from various sources (NOT limited to mySQL, Oracle, NoSQL, Flat files like PDF, Excel, CSV, .docx, Live/streaming) to hadoop/hdfs by using wide range of bigdata tools; 3. Ensure the data...

Need to create server part and client part for a web service like Uber, but Uber for goods delivery. Description: There is a big city, several routes depart from the big city in different directions. There are a lot of small towns along the track where people often order goods from the big city. In the big city, on the outskirts there are special stocks in the directions of each track. People ca...

i need someone to create 1 test case for selenium for a url and sending some keys with loop, once we talk i can show and explain what i mean

I need to transfer the large amount of data from HDFS to AWS and want a support for the same..

Big data developer Project is a business intelligence type of solution dealing with data from different sources: logs, site visitors, CRM lists or purchase history data, etc. An EMR based solution is used to analyze and develop person-based marketing campaigns that can be deployed to any of the media platforms. Tech stack: AWS: S3, EC2, Elastic Beanstalk, Aurora RDS, EMR DB: MySQL (using Aurora D...

Project Description The project is about capturing the data generated by a device in a realtime and processing the data to derive some device metrics like device status and peripheral count. The project defines a part of real time requirement from the client on capturing and processing telemetry data from devices The data should be captured using the push model from 'REST' services by a ...

Need a strong Dev Ops engineer for a project with following experience - 5-10 yrs experience - Expertise working in Linux platform. - Programming experience (Java, or shell scripting) - Containerization of application - knowledge of Kubernetes - Prefer candidate to be in India (Bangalore)

Need a guy who is pro in both Cloudera, Horton works and AWS to help in proxy

Pull information from two sources into an elastic search environment, perform machine learning (using training data from one of the sources), present the data in meaning full way.

This project is used to identify the human act by image processing in real time, and the main intention is to communicate the identified gestures using the camera system we want to show image analysis with different kind of algorithms and dataset on multiple GPU .. we want to get the machine benchmarking done .. we will test and train it on multiple kinds of machines example : we can use algorit...

Build a project from scratch that has end to end solution using Big data technologies

I want to make a project of web page ranking using Hadoop(big data) containing java as a backend and for database MySQL and i want to complete my project in 5 days.

I need some help with Hadoop, mapreduce, setting up directories etc.