Etl unixpekerjaan

Permasalahan sbb: Programmer saya yg lama membuatkan Task scheduler utk ETL di sql server, dan skarang tidak bisa dibuat otomatis. Sebelumnya berjalan nomormal tapi kemudian fungsi otomatisnya hilang. Mohon untuk bisa diperiksa sql servernya

Permasalahan sbb: Programmer saya yg lama membuatkan Task scheduler utk ETL di sql server, dan skarang tidak bisa dibuat otomatis. Sebelumnya berjalan nomormal tapi kemudian fungsi otomatisnya hilang. Mohon untuk bisa diperiksa sql servernya

Job Title: Digital Technolo...Boomi or other available integration services • Experience in creating and maintain data structures in Snowflake Data warehouse • Experience working with Data Analysts to ensure data is prepared and available through development of queries, views, schemas, etc. • Understand integration points in other products and design data transformations • Manage ETL processes and systems • Recommend improvements to data architecture to improve utilization and performance • Exposure to WordPress, NetSuite Commerce Advanced (SCA), Boomi, Snowflake and Experience working with Web Technologies (JavaScript’ • Knowledge of NetSuite, Dynamics 365 CRM or ...

...interaction for solutioning – Cloud Data Quality (CDQ), Cloud Data Integration (CDI), Cloud Application Integration (CAI), and other microservices. • Strong experience with MDM Solution Design, Data Integration, Data Modelling, Customization and Configuration, Data Governance, Performance Optimization, Collaboration and Documentation • In-depth knowledge of data integration, ETL processes, and data quality management. • Familiarity with Salesforce and SAP data structures and integration methods. • Excellent problem-solving skills and the ability to troubleshoot complex data issues. • Strong communication and collaboration skills, with the ability to engage with both technical and non-technical s...

...Tasks, Stages, Views and Tables. • Experience working with SQL Query optimization and Cost optimization of Snowflake resources. • implement security measures to protect sensitive data such as, Role-Based Access (RBAC), Data Encryption and Data Masking. • Proficiency in building ELT/ETL pipelines with focus on Change Data Capture (CDC), History Snapshots, Audit logging and other best practices. • Working experience with any of the ETL tools such Five trans, Informatica, etc., • Perform data profiling on source data and define data quality rules. • Solid understanding of Master Data Management concepts, principles and best practices. • Experience with MDM tools pr...

...development of functionality and stability o Develop APIs in digital properties to support integrations with other products • Integrations o Develop Integrations between products utilizing Boomi or other available integration services o Understand integration points in other products and design data transformations • Data o Create and maintain data structures in Snowflake Data warehouse o Manage ETL processes and systems o Work with Data Analysts to ensure data is prepared and available through development of queries, views, schemas, etc. o Recommend improvements to data architecture to improve utilization and performance Qualifications: • Experience with at least 3 of the 4 the following technologies o Wordpress o Netsuite Suite Commerce Advanced (SCA) o Boomi o...

Sila Dafter atau Log masuk untuk melihat butiran.

I am looking for a skilled Unix script developer who can help me with a file manipulation task. Specifically, I need the script to perform various operations on files, such as renaming, copying, and deleting. I have specific input and output requirements for the script, so it is important that the developer is able to meet these requirements. Additionally, the script will need to interact with an external system, so experience with integrating Unix scripts with external systems is preferred. If you have experience in Unix scripting, file manipulation, and working with external systems, please bid on this project. Thank you!

We are looking for an intermediate Snowflake developer with experience in data warehousing. The main task for the developer will be handling data warehousing projects. It is important that the developer is familiar with Snowpipe. We are open to any other tools or software that the developer may be familiar with. Ideal skills and experience for the job: - Inter...projects. It is important that the developer is familiar with Snowpipe. We are open to any other tools or software that the developer may be familiar with. Ideal skills and experience for the job: - Intermediate level of experience in Snowflake development - Strong understanding of data warehousing concepts - Familiarity with Snowpipe - Knowledge of query optimization techniques - Experience with ETL processes and data e...

Requirements:- • Experience in Designs, develops, tests, deploys, and maintains enterprise-level applications using the Snowflake platform. • Understand requirement from stakeholders and deliver solutions. • Designing and developing data models and data warehouses • Developing and maintaining ETL processes • Creating and maintaining views, stored procedures, and other database objects • Taking ownership of a project and seeing it through to completion • Snowflake developers need expertise in SQL databases and many programming languages. • They can create data-intensive apps with flexible performance, scalability, and concurrency parameters. • Snowflake Cloud Development • Snowflake Adm...

Our team is looking for an experienced data engineer or data scientist with past projects in the scope...searches or otherwise to power custom LLM/gpt. Requirements: • Experience building frontend and backend connections for conversational LLM/gpt based on a saved corpus of text • Experience with Google Cloud Vertex AI • Experience with PostgreSQL databases or similar • Python programming • SQL knowledge Nice to Have: • Compatible time zone or flexible with US Eastern or Pacific Time Zone *Built ETL pipelines using Python and SQL with Cloud databases. We will ask for a sample code to review the quality before hiring for the role. If you are a data engineer/scientist with expertise in Python and are experienced in the tasks mentioned above, pl...

We are looking for some Generative AI expert who can write a code which can convert Tableau dashboards to Power BI. While we convert Tableau to Power bi it has 4 major components,... ETL work, modelling, Formulas and visualisation any idea using tool how much conversion would be perfect 99%, 95%, 90% or what ? I have a plan of this project like below. 1. Data Source Identification - Use some way to identify and replicate data sources in Power BI. - Apply code generation for data modeling. 2. Formula Conversion - Leverage NLP for Tableau formula identification. - Develop a mapping system and use code generation to translate formulas to Power BI DAX. 3. Visualization Conversion - Utilize NLP to recognize Tableau visualizations. - Develop mappings and use code generation to recreate ...

We are looking for some Generative AI expert who can write a code which can convert SAP BO dashboards to Power BI. While we convert SAP BO to Power bi it has 4 major components,... ETL work, modelling, Formulas and visualisation any idea using tool how much conversion would be perfect 99%, 95%, 90% or what ? I have a plan of this project like below. 1. Data Source Identification - Use some way to identify and replicate data sources in Power BI. - Apply code generation for data modeling. 2. Formula Conversion - Leverage NLP for SAP BO formula identification. - Develop a mapping system and use code generation to translate formulas to Power BI DAX. 3. Visualization Conversion - Utilize NLP to recognize SAP BO visualizations. - Develop mappings and use code generation to recreate Powe...

We are looking for some Generative AI expert who can write a code which can convert UI Path workflows to Power Automate workflows While we convert UI Path workflows to Power Automate workflows to it has 4 major components,... ETL work, modelling, Formulas and visualisation any idea using tool how much conversion would be perfect 99%, 95%, 90% or what ? I have a plan of this project like below. 1. Data Source Identification - Use some way to identify and replicate data sources in UI Path - Apply code generation for data modeling. 2. Formula Conversion - Leverage NLP for UI Path formula identification. - Develop a mapping system and use code generation to translate formulas to Power Automate 3. Object Conversion - Utilize NLP to recognize UI Path Objects. - Develop mappings and use...

We are looking for some Generative AI expert who can write a code which can convert QlikView dashboards to Power BI. While we convert QlikView to Power bi it has 4 major components,... ETL work, modelling, Formulas and visualisation any idea using tool how much conversion would be perfect 99%, 95%, 90% or what ? I have a plan of this project like below. 1. Data Source Identification - Use some way to identify and replicate data sources in Power BI. - Apply code generation for data modeling. 2. Formula Conversion - Leverage NLP for Qlikview formula identification. - Develop a mapping system and use code generation to translate formulas to Power BI DAX. 3. Visualization Conversion - Utilize NLP to recognize Qlikview visualizations. - Develop mappings and use code generation to recre...

Need assistance to build a live connection from Oracle ERP to Google Cloud Platform (GCP). The ideal candidate will have experience and proficiency in using tools such as IAM & admin, Cloud function, Cloud Scheduler, and Pub/Sub of GCP platform to write python scripts to build the ETL workflow

Need assistance to migrate data from Oracle ERP and Oracle EPM to Google Cloud Platform. It will involve ETL process

I am in need of an Azure Databricks expert to assist me with ETL tasks for my project. The specific tasks I require assistance with include data analysis and visualization, data processing and transformation, as well as model training and deployment. For the implementation of Azure Databricks, I have specific requirements that need to be met. The complexity level of the data to be processed is moderate. Ideal skills and experience for this job include: - Proficiency in Azure Databricks and its various functionalities - Strong understanding of data analysis and visualization techniques - Experience in data processing and transformation using Azure Databricks - Familiarity with model training and deployment in Azure Databricks If you have the necessary skills and experienc...

...IST M - F AWS Data Engineer Requirements • Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines. • Connect with stakeholders daily to discuss project progress and updates. • Work within an Agile process to deliver projects in a timely and efficient manner. • Have worked extensively on Redshift and understands performance tuning techniques and management of Redshift data workloads. • Design and develop Airflow DAGs to schedule and manage ETL workflows. • Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture. • Monitor and troubleshoot ETL pipelines to ensure smooth operation. • Custom Python functions to ha...

...where every action is equal to a set number of credits, with an interface to adjust the credit for each action. e. Reporting module, to include longitude/ latitude of each area, along with images. Videos (2 minutes ) and audio notes to be accessible online, as well as backend access of content with filtering and aggregation capabilities for each resource, user, action, report item and report. f. ETL module to integrate with other APIs and to extract data and map them back and forth. g. RFP module to generate requests for proposals. 1.1.3 INITIAL SITE MAP USER ADMINISTRATION DASHBOARD ├── LOGIN PAGE ├── FORGOT PASSWORD ├── COMPANY REGISTRATION ├── SUB ACCOUNT PAGE └── USER REGISTRATION PAGE ANNOTATION DASHBOARD ├── UPLOAD FILES ├── LOCATION/INVENTORY PAGE ├── MANAGE SITES PAGE...

PLEASE READ ATTCHCHD FILE. I am looking for a freelancer who can help me with SSIS and SSRS tasks. Specifically, I nee...ATTCHCHD FILE. I am looking for a freelancer who can help me with SSIS and SSRS tasks. Specifically, I need assistance with designing and developing ETL packages. Ideal Skills and Experience: - Strong knowledge and experience with SSIS and SSRS - Proficiency in SQL Server 2019 - Experience in designing and developing ETL packages - Familiarity with creating and managing data sources and reports - Ability to troubleshoot and optimize existing packages and reports In this project, I have existing databases that need to be integrated. Therefore, the freelancer should be able to work with existing databases and ensure smooth integration with the ETL...

I am looking for a freelancer...same in database 3. keeps a track of all orders in database so i can see monthly profit/loss 4. Can be with either the rest API or websocket. 5. Needs to be developed in C# 6. Should be able to handle other exchange such as BingX and Binance 7. Should be able to support more than one account in an exchange at the same time. The ideal interface for the bot would be console-based ( to be hosted on unix server so should support Mono ) Please bear in mind Mono supports .net frame work 7.0 and not upwards. Skills and experience needed for this project include: - Strong proficiency in C# programming language - Knowledge and experience in creating trading bots - Understanding of order types and trading strategies - Ability to develop a console-based ...

given numpy matrix with 900000 rows and 1000 columns data = (num_vectors, num_features).astype('float32') develop FAST, correct and reasonable for RAM python code to find top K (for example 3000) most similar rows and least similar rows. for similarity use cosine si...num_features).astype('float32') develop FAST, correct and reasonable for RAM python code to find top K (for example 3000) most similar rows and least similar rows. for similarity use cosine similarity compare with ground truth given by from import cosine_similarity just idea you may use faiss or hnswlib or annoy or other python packages easy to install on both windows and unix before application , tell me how long it takes for your python code to do this calualtions time 2 days

...maintain an identical development stack, and development will be done via Github and Jira via well-written scrum stories. We will do development in baby step tests where I test each partially-/fully-completed story using my Hammond keyboard upon story completion to confirm the software works as intended before proceeding to the next story. (I am a former coder, though my skills date back to C++/Unix, and are rusty.) I'm fully capable at the MacOS command line, and *mostly* ok using Git (though I need occasional help.) I encourage developers to suggest a method for making this work - e.g. testing framework, possible "keyboard simulator" to test the interactions, etc., though a full proposal for same need not be supplied at the outset. I will begin by ONLY being b...

...dimensión, hechos, jerarquías, niveles, métricas y operaciones OLAP. Del mismo modo, se pondrán en práctica los conocimientos sobre inteligencia de negocio y ETL, prestando especial atención al diseño e implementación del proceso básico ETL hasta culminar en un modelo en estrella, así como en la implementación de dimensión y hechos en la capa física. Se deberán realizar: La implementación de un pequeño modelo multidimensional, haciendo uso de Pentaho Business Analytics Server y su herramienta wizard para modelado multidimensional o puede utilizar cualquier otra herramienta para realizar el modelado. La implementación de un pequeño proceso E...

Deben implementar un ordenador lexicográfico (una versión más sencilla del programa sort en Unix) que funcione con uno o más archivos de texto o la entrada estándar y que imprima su salida en la salida estándar. Por ejemplo, si tienen el achivo : Hombres necios que acusáis a la mujer sin razón, sin ver que sois la ocasión de lo mismo que culpáis. Si con ansia sin igual solicitáis su desdén, ¿por qué queréis que obren bien si las incitáis al mal? Combatís su resistencia y luego con gravedad decís que fue liviandad lo que hizo la diligencia. Parecer quiere el denuedo de vuestro parecer loco al niño que pone el coco y l...

Sila Dafter atau Log masuk untuk melihat butiran.

...WordPress backend. 9. Optimize the website's performance by minimizing load times and maximizing responsiveness. Requirements: PHP Development and MySQL Database Management: ➢ experience in PHP development with a strong understanding of modern PHP practices. ➢ Proficiency in writing clean, efficient, and maintainable PHP code. ➢ Basic understanding & Knowledge about REST API Development and Unix Shell ➢ In-depth knowledge of MySQL database management, including query optimization and data modeling. WordPress Proficiency: Experience customizing and extending WordPress functionalities. API Integration Skills: Ability to integrate third-party APIs and services into the WordPress backend. Deliverables: A headless CMS website with frontend integration. Additional back...

I am looking for a Unix and Python programmer with experience in systems programming. The ideal candidate should have the following skills and experience: Specific programming languages: - Proficiency in Unix programming Domain experience: - Experience in systems programming Timeline: - The project needs to be completed in less than 1 month Skills and experience required: - Strong knowledge of Unix and Python programming - Experience in systems programming - Ability to work within tight deadlines

I am seeking a Python & Unix expert who can assist me with Python programming tasks. I would like the freelancer to use specific Python libraries or frameworks, particularly Pandas. The ideal candidate should have experience in Python programming and Unix shell scripting.

Data: Two Raw Data tables are attached in separate sheets: orders and merchants. Tasks: Import raw data tables in the Snowflake environment (you can request trial from Snowflake); Create an ETL pipeline to transform raw, unstructured Data into multiple relational tables. One should comment their thought process while preparing the pipeline; Add additional cleaning for Data, where they see it is required; Once all data is transformed, one should create a summary table(s), in a way that BI Analyst could use it to build report that answers following questions: How many orders per day are created? per each shop per each print provider per each sku How many order items per day are created? How many order items on average there are within one order? Run the pipeline and save a newly cr...

I am in need of assistance with Unix/Linux installation and configuration. I am looking for someone with experience in this area, who can help me with the following: - Troubleshooting any issues that may arise during the installation and configuration process - Providing guidance and support in setting up and configuring the Unix/Linux system Overall, I am seeking a skilled individual who can provide expert assistance in Unix/Linux installation and configuration, and who can efficiently handle the tasks mentioned above. Below is the disk partition snapshot of the RHEL 8.8. [root@PRPD-AML-WEB-01 ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 100G 0 disk ├─sda1 8:1 0 600M 0 part /boot/efi ├─sda2 8:...

I am seeking a freelancer to assist with data migration from postgre to snowflake ...seeking a freelancer to assist with data migration from postgre to snowflake for my project. The ideal candidate will have experience in data migration and be familiar with manually migration from postgres to snowflake . The size of the data to be migrated is less than 13mb. i have pgadmin4 insalled locally manually migration from postgres to snowflake one to one mapping it will be without using any etl tool only manual migration one to one mapping who can complete in between in 2 days . Required Skills and Experience: - 8 years Experience in data migration - Familiarity with manual migration that is one to one mapping from postgres to snowflake . - Ability to handle data migration of less ...

Tengo la base de datos pero me falta el area de staging y el dwh

I am looking for a skilled database analyst and ETL specialist to help me with a database analysis and ETL process. Objective: The client has a specific goal or objective for this project. Data Size: The size of the data that needs to be processed is not specified. Ideal Skills and Experience: - Strong experience in SQL database analysis and ETL processes - Knowledge of SQL databases and their optimization techniques - Familiarity with various ETL tools and processes - Ability to identify and resolve database performance issues - Excellent problem-solving skills and attention to detail - Strong communication and collaboration skills for working with the client to define project goals and objectives

...Error, I am looking some to take my remote and load it. also can understand me why this error was showing so wants to learn as well. Have around 5 table around 200 Mb Size File Format: CSV & Flat File Transformations and Data Cleansing: None required Database Size: Small (less than 1GB) Skills and Experience: - Proficiency in SSIS (SQL Server Integration Services) - Strong knowledge of ETL (Extract, Transform, Load) processes - Experience in loading data from CSV files into SQL databases - Familiarity with data mapping and data validation - Understanding of database structures and SQL queries - Attention to detail and ability to troubleshoot and resolve any data loading issues Please note that this is a one-time project and the ideal candidate will be able to comple...

I am looking for a skilled data engineer with experience in dbt and Snowflake to assist me with ETL development and data modelling for an ongoing project. Tasks: - ETL development using dbt and Snowflake - Data modeling - Performance tuning Requirements: - Strong experience in dbt, Snowflake, git/github & ETL development - Expert level proficiency in dbt and Snowflake is a must This is an ongoing project, so I need someone who can provide continuous support. If you have the necessary skills and experience, please reach out to discuss further details.

...meaningful conclusions. - To allow the assessor to easily check the correctness of your implementation, your submitted files should include a 'main()' function that: 1. accepts input data in the same format as the data files provided; 2. takes a file path to the data file as a command-line argument when the program is 1 The given data files were generated on a Linux machine, and consequently have Unix line endings. 3. outputs the result sequence, one name per line, to the standard output. -You are not required to use the submitted 'main()' function when generating your performance data; this is just to facilitate checking the correctness of your implementation. Task 2: TDD Application The report should contain a narrative account of the TDD aspects of the dev...

Reimplement the RUSA ACP control time calculator with flask, ajax and MongoDB. ## Objectives: * Understand how can we build multiple container using Docker compose. * Understand the basics of the microservices notion. ## Dependencies: * Designed for Unix, mostly interoperable on Linux or macOS. May also work on Windows, but no promises. A Linux virtual machine may work. You may want to test on shared server (if available). * You must install [docker]() ## Instructions: * You have a minimal implementation of Docker compose under the [todo](todo) directory. Using compose, you can connect the flask app to MongoDB (as demonstrated in class). We also recommend you look at the `` file provided under resources in

I am looking for someone who has experience in data transformation using ETL techniques on SQL Server. Knowledge in extracting, transforming, and loading data from various sources into the SQL Server database. Experience in data migration, data cleansing and data integration Familiarity with different data sources and formats.

I am looking for a Python and Unix expert who can assist me with Python programming tasks. I have specific requirements and preferences for the programming language or version. The project needs to be completed as soon as possible. Ideal skills and experience for the job include: - Strong proficiency in Python programming - Extensive knowledge and experience in Unix system administration - Familiarity with the specific programming language or version preferred by the client

I am looking for an advanced Unix Python expert who can assist me with scripting tasks. Tasks: - Scripting in Unix Python - Web scraping using Unix Python - Data analysis using Unix Python Skills and Experience: - Advanced knowledge and experience in Unix Python scripting - Strong understanding of web scraping techniques using Unix Python - Proficient in data analysis using Unix Python Deadline: - Immediate assistance needed - completion within 24 hours

I am looking for a freelancer who can help me with my AWS Glue project. I need to set up Terraform code for AWS Glue job status notification. Services currently in use: - AWS Glue ETL Notification requirements: - I want to receive notifications for both successful and failed job runs. Email template: - A standard notification email is sufficient for me. Skills and experience required: - Experience with Terraform and AWS Glue - Knowledge of AWS services, specifically S3, EC2, and RDS - Familiarity with Lambda or EventBridge rule with SNS topic notification via email If you have the necessary skills and experience, please bid on this project.

...Your responsibilities will encompass: - Data Integration: Collaborate with cross-functional teams to collect, transform, and integrate financial data from various sources, ensuring data accuracy and consistency. - Data Modeling: Develop and maintain data models to support financial analytics and reporting, applying your finance background to create meaningful structures. - ETL Processes: Design and implement efficient ETL (Extract, Transform, Load) processes to streamline data pipelines and ensure timely data availability. - Quality Assurance: Perform data quality checks, validation, and troubleshooting to maintain data integrity and reliability. - Reporting: Generate financial reports and dashboards, providing insights to support data-driven decision-making. - Data Gover...

I am seeking a Unix and Python developer to assist me with scripting tasks. The ideal candidate should have experience in both Unix and Python development. Specific requirements for the development tasks are in place, and the project needs to be completed within 1 week. Skills and experience required: - Proficiency in Unix and Python development - Strong scripting skills - Ability to meet tight deadlines and deliver high-quality work within a short timeframe.

...an agile software development team using Scrum and/or Kanban • Experience with data structures and modelling and apply them to build solutions to get the best of time-complexity and space complexity. • Experience with the microservices Event-Driven Architecture and Solutions Design. • Strong expertise in architecting, implementing, and managing high-performance scalable J2EE applications on Linux/Unix platforms • Strong expertise in designing/developing with n-tier architectures (UI, Business Logic Layer, Data Access Layer). • Strong expertise in design and development of Amazon Web Services - AWS EB Stack, EC2, SQS, SNS, S3 SDKs • Strong expertise in Cloud deployment (eg. Docker, Kubernetes) • Strong expertise in building REST API’s &ndas...

I am looking for a software Python developer who can create a program with the following requirements: Intention is to read a message from a telegram channel and parse it, then as per certain conditions go to another telegram channel and hit some buttons in that channel. Basically web automation. I want to run this on unix, so you have to load the chrome in unix by stealth. 1. Parse the message and every element of the message in group 1(Pingbot) Get Contract address and Price from the message and store in a jason file with contract address. 2. Go to @unibotsniper_bot , enter /menu 3. Click on Buy tokens 4. Enter Contract address , press enter 5. Go to @unibotsniper_bot 6. Press sell limit 7. Parse the message. 8. Read number and token symbol 9. Enter the num...

I am looking for a Python software developer who can complete my project Intention is to read a message from a telegram channel and parse it, then as per certain conditions go to another telegram channel and hit some buttons in that channel. Basically web automation. I want to run this on unix, so you have to load the chrome in unix by stealth. 1. Parse the message and every element of the message in group 1(Pingbot) Get Contract address and Price from the message and store in a jason file with contract address 2. Go to @unibotsniper_bot , enter /menu 3. Click on Buy tokens 4. Enter Contract address , press enter 5. Go to @unibotsniper_bot 6. Press sell limit 7. Parse the message. 8. Read number and token symbol 9. Enter the number and press “Select Token...

Title: Strong AWS Data Engineer Needed for ETL Project Overview: I am seeking a highly skilled AWS Data Engineer to assist with an ETL project that involves specific expertise in the following AWS services: EC2, S3, Redshift, and Glue. The main objective of this project is to efficiently store, analyze, and migrate data using AWS services. I expect the project to be completed within 1-3 months. Responsibilities: The chosen candidate will be responsible for the following tasks: - Utilize EC2 for scalable computing power and efficient data processing. - Utilize S3 for secure and reliable data storage. - Utilize Redshift for high-performance data warehousing and analytics. - Utilize Glue for ETL (Extract, Transform, Load) processes to efficiently transform and migrate ...

I need someone with cosmos DB, python, event log handling, working with SFTP and basically ETL with GCP, python, airflow, and azure devops