Tapis

Carian terbaru saya
Tapis mengikut:
Bajet
hingga
hingga
hingga
Jenis
Kemahiran
Bahasa
    Status Pekerjaan
    4,108 hadoop hbase tugasan ditemui, harga dalam USD

    ...your candidature suitable for the below opening with our esteemed client. Hiring for "Spark developer role with US IT based Required Experience: 4+ years atleast two years of spark experience Salary : 40 lacs. Required Qualification: B.E/ Location- Hyderbad | Remote till covid end Timmings : 6:30PM-2:00AM IST Job Description: 1) 4-5 years of Hands-on experience on components of Hadoop Ecosystem like HDFS, Hive, Spark, Sqoop, Map Reduce and YARN 2) Handson Experience with data integration projects on AWS and database platforms (RedShift, Athena, Aurora). 3) Experience In AWS service like S3,IAM,EMR,EC2,AWS Glue, EMR 4) Experience in Azure service 5) Experience in Kafka,and steaming processes and real time jobs. 6) Experience work with cliets and requirement gaterin...

    $11 / hr (Avg Bid)
    $11 / hr Avg Bida
    3 bida

    Hi Amr S., I noticed your profile and would like to offer you my project. We can discuss any details over chat. I have some tasks to do in Hadoop and map reduce

    $35 (Avg Bid)
    $35 Avg Bida
    1 bida
    Observium Specialist 5 jam left
    DISAHKAN

    I need an observium specialist to do custom dashboard for: 1. Port Status Monitoring for servers 2. Monitor database health (MariaDB, MongoDB, Hadoop) 3. Server up and down status 4. Memory, hard disk, and resource utilisation

    $53 (Avg Bid)
    $53 Avg Bida
    3 bida

    Content based recommendation system using MapReduce, i.e. given a job description you should be able to suggest a set of applicable courses

    $172 (Avg Bid)
    $172 Avg Bida
    5 bida
    Data Engineer Tamat left

    ...to ensure quality of deliverables ● Rapidly understand and translate clients’ business challenges and concerns into a solution oriented discussion. Must Have: ● At least 6+ years of total IT experience ● At least 4+ years of experience in design and development using Hadoop technology stack and programming languages ● Hands-on experience in 2 or more areas: o Hadoop, HDFS, MR o Spark Streaming, Spark SQL, Spark ML o Kafka/Flume. o Apache NiFi o Worked with Hortonworks Data Platform o Hive / Pig / Sqoop o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho o Scrapy for crawling websites o Good to have knowledge of Elastic Search o Good to have understanding of Google An...

    $29 / hr (Avg Bid)
    $29 / hr Avg Bida
    6 bida

    ...left up to you how you pick necessary features and build the training that creates matching courses for job profiles. These are the suggested steps you should follow : Step 1: Setup a Hadoop cluster where the data sets should be stored on the set of Hadoop data nodes. Step 2: Implement a content based recommendation system using MapReduce, i.e. given a job description you should be able to suggest a set of applicable courses. Step 3: Execute the training step of your MapReduce program using the data set stored in the cluster. You can use a subset of the data depending on the system capacity of your Hadoop cluster. You have to use an appropriate subset of features in the data set for effective training. Step 4: Test your recommendation system using a set of request...

    $133 (Avg Bid)
    $133 Avg Bida
    5 bida

    ...same metrics to show which is a better method. OR ii) Improvement on the methodology used in (a) that will produce a better result. 2. Find a suitable paper on replication of data in hadoop mapreduce framework. a) Implement the methodology used in the paper b) i) Write a program to split identified intermediate results from (1 b(i)) appropriately into 64Mb/128Mb and compare with 2(a) using same metrics to show which is a better method. OR ii) Improvement on the methodology used in 2(a) that will produce a better result 3. Find a suitable paper on allocation strategy of data/tasks to nodes in Hadoop Mapreduce framework. a) Implement the methodology used in the paper b) i) Write a program to reallocate the splits from (2 (b(i)) above to nodes by considering the capabi...

    $158 (Avg Bid)
    $158 Avg Bida
    5 bida

    Problem Statement: Design scalable pipeline using spark to read customer review from s3 bucket and store it into HDFS. Schedule your pipeline to run iteratively after each hour. Create a folder in the s3 bucket where customer reviews in json format can be uploaded. The Scheduled big data pipeline will be triggered manually or automatically to read data from The S3 bucket and dump it into HDFS. Use Spark Machine learning to perform sentiment analysis using customer review stores in HDFS. Data: You can use any customer review data from online sources such as UCI

    $29 (Avg Bid)
    $29 Avg Bida
    1 bida
    scala hadoop Tamat left

    Problem Statement: Design scalable pipeline using spark to read customer review from s3 bucket and store it into HDFS. Schedule your pipeline to run iteratively after each hour. Create a folder in the s3 bucket where customer reviews in json format can be uploaded. The Scheduled big data pipeline will be triggered manually or automatically to read data from The S3 bucket and dump it into HDFS. Use Spark Machine learning to perform sentiment analysis using customer review stores in HDFS. Data: You can use any customer review data from online sources such as UCI

    $31 (Avg Bid)
    $31 Avg Bida
    1 bida

    Daily 8 Ho...Security, System Configuration, Database Security, etc. OS builds (Redhat, Debian/Ubuntu) CA hierarchy, Encryption and key management systems Vendor RfP process by providing a detailed set of technical capabilities and scoring vendor capabilities maintain VRA to automate deployment of PaaS Catalog High level designs and low level design DBaaS (MongoDB, MySQL multi master, PostgreSQL, Couchbase), Hadoop , service orchestration (Ansible, Terraform), Observability (Zabbix, ELK, Grafana, Prometheus, FluentD), APIGW (OpenResty, NGINX, KrakenD), SSL, DNS, HA-Proxy, Isitio, Consul, Vault, CyberArk, Envoy, OAUTH, JWT, Nexus Sonatype repository, messaging (Kafka, RabbitMQ, NATS), gRPC Vmware VRA blueprints development on top of vmware and K8S platforms Advanced knowledge of PaaS...

    $802 (Avg Bid)
    $802 Avg Bida
    15 bida

    Proficiency in SQL Writing, SQL Concepts, Data Modelling Techniques & Data Engineering Concepts is a must Hands on experience in ETL process, Performance optimization techniques is a must. Candidate should have taken part in Architecture design and discussion. Minimum of 2 years of experience in working with batch processing/ real-time systems using various technologies like Databricks, HDFS, Redshift, Hadoop, Elastic MapReduce on AWS, Apache Spark, Hive/Impala and HDFS, Pig, Kafka, Kinesis, Elasticsearch and NoSQL databases Minimum of 2 years of experience working in Datawarehouse or Data Lake Projects in a role beyond just Data consumption. Minimum of 2 years of extensive working knowledge in AWS building scalable solutions. Equivalent level of experience in Azure or Google Cl...

    $1864 (Avg Bid)
    $1864 Avg Bida
    17 bida

    Data Engineers 6+ yrs : At least 6+ years of total IT experience ● At least 4+ years of experience in design and development using Hadoop technology stack and programming languages ● Hands-on experience in 2 or more areas: o Hadoop, HDFS, MR o Spark Streaming, Spark SQL, Spark ML o Kafka/Flume. o Apache NiFi Worked with Hortonworks Data Platform o Hive / Pig / Sqoop o NoSQL Databases HBase/Cassandra/Neo4j/MongoDB o Visualisation & Reporting frameworks like D3.js, Zeppellin, Grafana, Kibana Tableau, Pentaho o Scrapy for crawling websites o Good to have knowledge of Elastic Search o Good to have understanding of Google Analytics data streaming. o Data security (Kerberos/Open LDAP/Knox/Ranger) ● Should have a very good overview of the current landscape...

    $1956 (Avg Bid)
    $1956 Avg Bida
    2 bida

    We are looking for an Hadoop expert for our Organization.

    $7 / hr (Avg Bid)
    $7 / hr Avg Bida
    7 bida

    I need 3 resumes who have 2 year experience, 3 year experience and 5 year experience in Hadoop/Big Data/Data engineer

    $16 (Avg Bid)
    $16 Avg Bida
    39 bida

    LDAP service on Oracle Linux 7.3 with rpm packages. LDAP for HDP-2.5.3.0 3. Install and configure Ranger HDP service security on Hbase and Solr tables and collection and validate the security with 5 users

    $156 (Avg Bid)
    $156 Avg Bida
    1 bida

    ...looking for a tech co-founder, but if a contractor fits I'm open to it. If you are interested in being a co-founder let me know and we can discuss details. Need to be in the U.S. Example tech stack may include: Programming languages: HTML5/CSS3 Frameworks: Node.js, React Databases: MySQL Cloud platforms: Amazon EC2, Amazon S3 Analytics: Google Mobile App Analytics, Flurry Analytics, Hadoop, Hive, MixPanel, Localytics, Mode, Parquet, Pig, Presto, Spark CDN services: Amazon CloudFront Streaming protocols: RTMP, Adobe HTTP Dynamic Streaming, Apple HTTP Live Streaming, M2TS, MPEG-DASH, Microsoft Smooth Streaming, WebRTC, RTSP/RTP Media formats: MKV, MP4, AVCHD, AVI, DMW, MOV, FLV, WMV, SWF Codecs: H.264/AVC, FFmpeg, XviD Media containers: MP4, FLV Geolocation:...

    $50 / hr (Avg Bid)
    Perjanjian Kerahsiaan
    $50 / hr Avg Bida
    41 bida

    ...taking advantage of the CI/CD pipelines when possible - Help with troubleshooting and configuration fine-tuning on several platforms (apache, haddoop, hbase etc) - Build and maintain a local testing environment replica for developers. - Help plan for "non hyper cloud" deployments. OpenStack, ProxMox, Kubernetes. All are on the table but the most "appropriate" one must be selected considering the architecture and CI/CD capabilities. - Build and maintain "on prem" alternatives of the AWS structure. This will include hardware planing (server) but also deployment of several VMs (or containers at some point) with techs including php+nginx, hadoop with hbase (and phoenix), sql database (probably mysql) and CEPH object storage. - Be the techni...

    $17 / hr (Avg Bid)
    $17 / hr Avg Bida
    17 bida

    Hi I would like to get some help on hadoop stack like Python (Design patterns), Pyspark and SQL. If anyone has knowledge on this stack please let me know

    $126 / hr (Avg Bid)
    $126 / hr Avg Bida
    31 bida

    We are developing a bioinformatics platform. Aside from the web application written in php, the core technology stack is * php * nodejs * javascript * jquery and we are looking for one or two good full stack developers to help our existing teams. * Experiience with big data (hadoop) * Experience with data upload operations (we need surgeon precision on this topic as we are working with large datasets) is definetely a plus. This is a long term position after a decent amount of trial period.

    $16 / hr (Avg Bid)
    $16 / hr Avg Bida
    106 bida

    Implementation in hadoop compiler

    $75 (Avg Bid)
    $75 Avg Bida
    3 bida
    Apache Hadoop Tamat left

    Implementation in Hadoop compiler

    $150 (Avg Bid)
    $150 Avg Bida
    4 bida

    PaaS l...Security, System Configuration, Database Security, etc. OS builds (Redhat, Debian/Ubuntu) CA hierarchy, Encryption and key management systems Vendor RfP process by providing a detailed set of technical capabilities and scoring vendor capabilities maintain VRA to automate deployment of PaaS Catalog High level designs and low level design DBaaS (MongoDB, MySQL multi master, PostgreSQL, Couchbase), Hadoop , service orchestration (Ansible, Terraform), Observability (Zabbix, ELK, Grafana, Prometheus, FluentD), APIGW (OpenResty, NGINX, KrakenD), SSL, DNS, HA-Proxy, Isitio, Consul, Vault, CyberArk, Envoy, OAUTH, JWT, Nexus Sonatype repository, messaging (Kafka, RabbitMQ, NATS), gRPC Vmware VRA blueprints development on top of vmware and K8S platforms Advanced knowledge of PaaS...

    $665 (Avg Bid)
    $665 Avg Bida
    8 bida

    need someone to help me with hadoop and to support in completing assignment in HIVE thanks

    $21 (Avg Bid)
    $21 Avg Bida
    11 bida

    The purpose of this project is to develop a working prototype of a network monitoring and reporting Platform that receives network health and status, traffic data from several network infrastructure monitor...network monitoring and reporting Platform that receives network health and status, traffic data from several network infrastructure monitoring sources, and produces an aggregate of network status data for processing by a data analytics engine. This prototype will be known as NetWatch. The NetWatch solution will utilize data processing and analytics services via the Hadoop infrastructure, and data reporting features of the Hbase or MYSQL/Datameer tool. The prototype will be used by the Network A&E team to determine its viability as a working engine for network ...

    $8 - $19
    $8 - $19
    0 bida

    You are given a large collection of (English) text documents (as files). For each document, compute the top 20 keywords by relevance scores. For a keyword w and a document d the relevance score is given by T(w,d)/D(w,d) : • where T (w,d) = count(w,d)^0.5 where ^ denotes exponentiation and • count(w,d) is the number of occurrences of w in d and • D(w,d) is the fraction of documents in the collection in which w occurs (i.e. x/N if w occurs in x documents out of N, the total number of documents in the collection). Also compute the intersection of all the top-20 keywords.

    $8 - $19
    $8 - $19
    0 bida

    I need full stack app developer for an app with the following tech stack: • Programming Languages: JavaScript, Ruby, Java, Sass • Frameworks: Rails • Libraries: React • Databases: MySQL, Amazon RDS, Redis, MongoDB • Servers and cloud computing services: NGINX, Amazon S3, Amazon EC2, Amazon EBS, Amazon ElastiCache • Big data processing: Hadoop, Presto, Airpal, Druid • Workflow management: Airflow

    $404 (Avg Bid)
    $404 Avg Bida
    31 bida

    I persuing big data program from nit, need support to complete few assignment and capstone project, candidate must know java, scala hadoop, hive and spark

    $125 (Avg Bid)
    $125 Avg Bida
    10 bida

    Please have a look at the below stack. 1. Bash Scripting. 2. Hive 3. Scala Spark 4. HBase and other regular big data technologies.

    $509 (Avg Bid)
    Tempatan
    $509 Avg Bida
    17 bida

    - Backup HBase database on internal infrastructure

    $16 / hr (Avg Bid)
    $16 / hr Avg Bida
    3 bida

    We are looking for a machine learning engineer who must have the following experience: 1. python coding: +7 years of experience 2. Machine Leaning: +5 years of experience (Scikit-Learn, TensorFlow, Caffe, MXNet, Keras, XGBoost) 3. AI/Deep Learning: +5 years of experience 4. Cloud computing: AWS, S3, EC2, EMR, SageMaker, ECS, Lambda, IAM 5. distributed computing technology: Hadoop, Spark, HBase, Hive / Impala, or any similar technology Should be an independent developer, NO CONSULTING COMPANY There will be series of technical interview about python coding, machine learning, AI , cloud computing. Candidate must have an excellent skill in python coding and be able to answer challenging python questions during the interview

    $55 / hr (Avg Bid)
    $55 / hr Avg Bida
    13 bida

    I need guidance to create Create Software Internship-Online Programme - World Wide. Templates for Internship - Linux,Data base,Bigdata-Hadoop,Kafka,Devops-Docker,Kubernetes Quiz/Online Exams 4. How to handle End to end Program

    $131 (Avg Bid)
    $131 Avg Bida
    5 bida

    Mini online project to be done together in 45mn

    $45 (Avg Bid)
    $45 Avg Bida
    4 bida

    Design, code, test Hive, Sqoop, HBase, Yarn, UNIX Shell scripting Spark and Scala mandatory You should have working experience in previous projects not a beginner level projects so please be ready to design develop and fix the bugs. Working hours and all We can decide over the chat.

    $55 / hr (Avg Bid)
    $55 / hr Avg Bida
    4 bida

    I need a person who has a skill set of both hadoop, hive and Talend because we are doing a Migration project in which extracting the data from hive tables using Talend Big Data

    $6 / hr (Avg Bid)
    $6 / hr Avg Bida
    6 bida

    1) Develop an aggregate of these reviews using your knowledge of Hadoop and MapReduce in Microsoft HDInsight. a) Follow the same approach as the Big Data Analytics Workshop (using the wordcount method in HDInsight) to determine the contributory words for each level of rating. b) Present the workflow of using HDInsight (you may use screen captures) along with a summary of findings and any insights for each level of rating. MapReduce documentation for HDInsight is available here 2) Azure data bricks for some insights Provide the following: a) A screen capture of the completed model diagram and any decision you made in training the model. For example, rationale for some of the components used, how many records have been used for training and how many for testing. b) A set of metrics...

    $148 (Avg Bid)
    $148 Avg Bida
    7 bida

    More details will be shared via chat

    $15 (Avg Bid)
    $15 Avg Bida
    4 bida

    am trying to run hbase backup command and got below error root@machine:~/hbase-2.4.12# hbase backup Error: Could not find or load main class backup Caused by: : backup need to fix that some tips below : Hbase install below Just enable the configuration on xml file and start the hbase and confirm is working well run Hbase on linux Ubuntu some helps below:

    $13 / hr (Avg Bid)
    $13 / hr Avg Bida
    3 bida

    I am looking for someone that can work on my project full time. Please don't waste my time and your time. Please read the post before you bid. - Good Java with hadoop experience -Zookeeper Lock -Vertica -Elastic Search The hours are from 10 to 4:30 pm eastern New York time. Someone that is knows what he is doing and also can learn along the project. Please don't waste my time and your time, if you don't agree with the budget and time. Also need to work on client's laptop.

    $783 (Avg Bid)
    $783 Avg Bida
    11 bida

    Looking for a two resources for my project. One is a java person another is Kafka person. This is a full time support job. Looking for someone that can work long term. Please be sure to work on Eastern time. Please don't waste my time and your time. Here are the following skill sets which i am looking for. Kafka developer Skills; -Java -Kafka -SQL -Postman Senior Java Developer -Java ...for a two resources for my project. One is a java person another is Kafka person. This is a full time support job. Looking for someone that can work long term. Please be sure to work on Eastern time. Please don't waste my time and your time. Here are the following skill sets which i am looking for. Kafka developer Skills; -Java -Kafka -SQL -Postman Senior Java Developer -Java with spring boot ...

    $21 / hr (Avg Bid)
    $21 / hr Avg Bida
    15 bida

    moving data from wkc to atlas. There is an issue in one of the category relationship mapping

    $88 (Avg Bid)
    $88 Avg Bida
    3 bida

    Expert level knowledge in AWS services like EMR, S3. Extensive experience in python, pyspark, Hadoop, hue, presto, bash shell script Expert in Apache airflow, creating and troubleshooting DAGs Good troubleshooting skills Experience with Lambda and Step function Good exposure with CI/CD skills Good experience with Talend Experience with Vertica

    $627 (Avg Bid)
    $627 Avg Bida
    5 bida

    Looking for someone who has a great knowledge in Spark Scala and Big data Technologies such as hadoop, hive etc

    $774 (Avg Bid)
    $774 Avg Bida
    9 bida

    Looking for sql expert to do development to use hadoop vm by following instrructions, i can share details with you , thank you, Looking for somone experience in Big cloud Data management.

    $173 (Avg Bid)
    $173 Avg Bida
    6 bida

    Hi , Looking for somone having Expertise in cloud database management . We need to use hadoop vm by foloowing instrructions. Thank you , I will give you all related details , Actually i need somone who is available and can finished in 12 hour's Thank you

    $22 (Avg Bid)
    $22 Avg Bida
    4 bida
    cloud database Tamat left

    cloud database management class project using hadoop vm

    $95 (Avg Bid)
    $95 Avg Bida
    2 bida

    I am looking for a Senior Java developer with Hadoop Experience. Looking for someone that is serious and Please don't waste my time. Before you bid for the project, please read it carefully.. This project is from 10 am to 3 pm eastern time. Here are the skill sets which i am looking for: -Java -Vertica -Hadoop(little bit of hadoop) - Zookeeper This is a long term position. Don't bid for the project, if you can't commit to the time and project budget..

    $777 (Avg Bid)
    $777 Avg Bida
    7 bida

    Roles And Responsibilities: Hadoop development and implementation. Loading from disparate data sets. Pre-processing using Hive and Pig. Designing, building, installing, configuring and supporting Hadoop. Translate complex functional and technical requirements into detailed design. Perform analysis of vast data stores and uncover insights. Maintain security and data privacy. Create scalable and high-performance web services for data tracking. High-speed querying. Managing and deploying HBase. Being a part of a POC effort to help build new Hadoop clusters. Test prototypes and oversee handover to operational teams. Propose best practices/standards. Skills Required: Good knowledge in back-end programming, specifically java, JS, Node.js and OOAD Good knowledge of...

    $11 / hr (Avg Bid)
    $11 / hr Avg Bida
    1 bida

    I am looking someone who has good experience in Python, spark, shell scripting , Hadoop, hive , sql, git, sqoop, oracle to develop the data pipeline. Also, any cloud experience- GCP/AWS

    $15 / hr (Avg Bid)
    $15 / hr Avg Bida
    18 bida

    Hi Tapasi K., I noticed your profile and would like to offer you my project. Write a spark submit job that accesses a data in a hive table in one hadoop/spark cluster , accesses data in an hbase table in another hadoop cluster , combine( do some aggregation) this data and save result in both hive and hbase. P.S. Hive is in a different hadoop cluster than hbase ( both in same network / VPC subnet ) .

    $100 (Avg Bid)
    $100 Avg Bida
    1 bida

    Looking for a two resources for my project. One is a java person another is Kafka person. This is a full time support job. Looking for someone that can work long term. Please be sure to work on Eastern time. Please don't waste my time and your time. Here are the following skill sets which i am looking for. Kafka developer Skills; -Java -Kafka -SQL -Postman Senior Java Developer -Java ...for a two resources for my project. One is a java person another is Kafka person. This is a full time support job. Looking for someone that can work long term. Please be sure to work on Eastern time. Please don't waste my time and your time. Here are the following skill sets which i am looking for. Kafka developer Skills; -Java -Kafka -SQL -Postman Senior Java Developer -Java with spring boot ...

    $16 / hr (Avg Bid)
    $16 / hr Avg Bida
    13 bida