
Open
Posted
•
Ends in 2 hours
Paid on delivery
Hiring: Senior Data Engineer (Freelance | Immediate Joiners Preferred) Job ID: GKS2105_4 Client: Ksolves (Check duplicacy if interviewed within last 6–12 months) We are looking for 2 strong Senior Data Engineers for a freelance opportunity. Role Details: Experience: 6+ Years Budget: ₹70,000 per month Work Mode: Work From Home Engagement Type: Freelance (You can work on multiple jobs; no restrictions as long as deliverables are completed on time) Interview Process: AI Interview + L1 + 2 Customer Rounds Key Responsibilities: - Design and build scalable, multi-tenant systems on AWS (Glue, Step Functions, Lambda, ECS Fargate, DynamoDB, S3, SageMaker) - Develop and maintain high-volume data pipelines using incremental ETL techniques - Build Lambda-based microservices and workflow orchestration using Step Functions - Contribute to backend services, APIs, dashboards, and customer-facing features - Support ML/MLOps workflows including model training and deployment - Implement monitoring, error handling, and automated recovery systems - Ensure data quality, validation, and anomaly detection - Design reusable, scalable data schemas and APIs - Contribute to CI/CD pipelines with automated testing and deployments Required Skills: - Strong Python (5+ years), SQL, Pandas/PySpark - AWS expertise (Lambda, Glue, S3, Athena, DynamoDB, ECS Fargate) - Experience with data lakes and serverless architectures - Backend/API development (REST, microservices, event-driven systems) - Working knowledge of Node.js or willingness to learn - Exposure to ML/MLOps (SageMaker, model lifecycle) - Experience with large-scale data processing and distributed systems - Strong understanding of testing, monitoring, and CI/CD practices - Security best practices (encryption, access control, governance) Nice to Have: - Marketing analytics, MMM, attribution - Infrastructure as Code (Terraform, CDK, CloudFormation) - Frontend exposure (Vue.js, [login to view URL], TypeScript) Qualifications: - Bachelor’s or Master’s in Computer Science or related field - Proven experience building enterprise-grade production systems Interested candidates can share their profiles for immediate consideration.
Project ID: 40460687
25 proposals
Open for bidding
Remote project
Active 16 hours ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
25 freelancers are bidding on average ₹60,653 INR for this job

Not all 15 years of experience are born equal, and this is where Mexin Web Infotech stands out. Being at the forefront of software engineering since its conception, we have honed our skills to deliver only the highest-quality solutions. Even more enticing, we don't just write clean code; rather, we architect entire digital ecosystems that are highly scalable, secure and designed to eliminate any possibility of technical debt now and in the future. We understand that your core requirement is for a Senior Data Engineer in regard to AWS architecture. As a seasoned team led by a veteran Senior Software Engineer and Team Architect, AWS (specifically Lambda, Glue, S3, Athena, DynamoDB and ECS Fargate) has long been part of our daily vocabulary. In addition to this, we share a vision that aligns core Python (over five years of experience) and SQL skills with domain-specific tools such as PySpark and Pandas required in data engineering. Another crucial aspect you mentioned is working knowledge of Node.js or willingness to learn one. Here's where Mexin shines again. While primarily being experts with Python on the backend using Rest APIs for microservices-based architecture that your project mandates, we are well-versed with Node.js too. This makes us capable not just in one area but ensures even compatibility in a diverse tech environment. Best regards, Team Mexin web infotech
₹75,000 INR in 30 days
4.7
4.7

Hello there , Good morning! I’ve carefully checked your requirements and really interested in this job. I’m full stack node.js developer working at large-scale apps as a lead developer with U.S. and European teams. I’m offering best quality and highest performance at lowest price. I can complete your project on time and your will experience great satisfaction with me. I’m well versed in React/Redux, Angular JS, Node JS, Ruby on Rails, html/css as well as javascript and jquery. I have rich experienced in Big Data Sales, Pandas, Hadoop, Elasticsearch, SQL, PySpark, Python and ETL. For more information about me, please refer to my portfolios. I’m ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details.. Looking forward to serve you
₹62,440 INR in 6 days
3.2
3.2

Hii,I’m a Software Engineer Udacity certified in Full Stack Web Dev and Data Analysis track with over 4+ years of experience building scalable backend systems, RESTful APIs, and automation solutions using these tracks including Java (Spring Boot), Python/Django, and modern low-code tools like N8N. I focus on turning complex requirements into efficient, reliable systems that save time and drive real results. With experience across enterprise, freelance, and self-driven projects, I bring strong problem-solving skills, adaptability, and a results-oriented mindset to every project. I’d be glad to connect and explore how I can add value to your team or business. Check my profile : https://www.freelancer.com/u/haitham1996?frm=haitham1996&sb=t
₹75,000 INR in 1 day
3.3
3.3

I see you're looking for a Senior Data Engineer who can jump in quickly. I've got solid experience with Python and ETL processes that can help streamline your data workflow. What specific challenges do you want to tackle first?
₹67,500 INR in 7 days
2.5
2.5

Drawing from my 9+ years of experience in website and mobile app development, I am Neha - a seasoned Python developer, proficient in E-commerce solutions and CMS-based websites. Sharing **Ksolves'** vision of turning ideas into reality, I'm eager to contribute as a Senior Data Engineer to power your scalable systems on AWS platform. Throughout my career, I’ve consistently designed and built advanced, multi-tenant architectures using AWS services such as Glue, Step Functions, Lambda and DynamoDB - all integral components for this role with Ksolves. Additionally, my strong SQL skills and Python expertise combined with deep knowledge in backend/API development (REST, microservices) align perfectly with your requirement to maintain high-volume data pipelines using ETL techniques. Working with a multitude of clients has honed my keen understanding of our world today- one that values not only the code quality that defines the product but the aftercare that ensures its continued success. And that's what I offer: effective cost of project encompassing great deliverables within budgets alongside free post-completion support for 3 months. Together let us achieve new milestones with your data systems.
₹56,250 INR in 7 days
2.0
2.0

Coming from a focus on data-centric development for over 6 years, I strongly believe I am a top candidate for this Senior Data Engineer position. I have adept knowledge of AWS (Glue, Step Functions, Lambda, ECS Fargate, DynamoDB, S3, SageMaker) and extensive experience developing high-volume data pipelines using incremental ETL techniques.
₹56,250 INR in 7 days
1.3
1.3

I'm excited to submit my bid for the Senior Data Engineer Freelance Position. Upon reviewing the job description, I'm confident that my expertise in building scalable, maintainable, and reliable data engineering systems aligns perfectly with your needs. My primary strength lies in delivering complex data engineering solutions that work under real usage, not just proof of concepts. A key takeaway from this job is that the main value here is delivering a clean, maintainable implementation that works under real usage. This resonates with my experience in building Jarvis AI - Personal Automation Assistant, where I orchestrated 30+ automated workflows across scraping, system actions, and API-driven automation with a strong focus on maintainability and reliability. I'd like to propose an execution plan that starts with a thorough understanding of your existing service and technical constraints. This will ensure that we prioritize the most critical components and deliver a robust backend structure, reliable deployment, and clean integrations. My deliverables will include clean backend code, environment setup instructions, error handling, API integration flow, and a comprehensive README.
₹60,144 INR in 7 days
1.0
1.0

Hi, I can help with building scalable multi-tenant AWS data pipelines and serverless microservices for production-grade analytics and dashboards. I’d start by reviewing your current pipeline patterns and data quality needs, then draft an AWS design using Glue, Step Functions, Lambda, DynamoDB, and S3 with incremental ETL and monitoring. To reduce risk, I’ll set up validation, anomaly checks, and automated recovery with CI/CD and tests. Which ETL framework do you use today (Glue PySpark or Lambda/Python), and are dashboards tied to S3/Athena or DynamoDB? Share your current architecture/stack and I’ll suggest a fast path for immediate join.
₹37,500 INR in 3 days
0.0
0.0

Hello. The hard part in these pipelines is keeping incremental ETL consistent when Glue jobs, Lambdas, and Step Functions retry out of order and create duplicate or partial loads. I’d design a clear lakehouse flow: S3 raw/processed/curated, Glue for batch transforms, Lambdas for event ingestion with idempotency keys, and Step Functions strictly orchestrating retries with DLQ isolation. DynamoDB becomes the state layer for dedup + progress tracking. Most failures usually come from silent schema drift and retry storms, so I’d enforce schema validation at ingestion and add CloudWatch + custom metrics for backpressure visibility. I’ve built a multi-tenant ingestion pipeline for analytics events where we solved duplicate loads and cross-tenant isolation issues in production. Happy to map the AWS architecture and failure modes before implementation.
₹56,250 INR in 7 days
0.0
0.0

Architected BioVerse for BP on Lambda+AppSync—exact pattern fits your data pipeline needs. 14 years Python/AWS, 6+ years high-volume ETL: Redshift, DynamoDB, S3, step orchestration. Built 3-tier microservices with incremental ETL for pharma fintech. Your scope: Lambda workflows, Glue, SageMaker, CI/CD—delivered in 12 days. Week 1: architecture review + core ETL templates. Week 2: full deployment + monitoring. Question: what's your current bottleneck—query latency or pipeline failures? Risk reversal: milestone-based, deploy early. — Brijesh, Sonraj Labs
₹65,000 INR in 12 days
0.0
0.0

As an experienced software engineer with a profound understanding of data engineering, I believe I would be an extraordinary fit for this project. Over the course of my 12+ year career as a full-stack developer and database architect, I've been able to master both Python and SQL—two key components of your Senior Data Engineer role. Additionally, I possess diverse experience building microservices and workflow orchestration using Step Functions, alongside contributions towards developing scalable systems on the AWS platform. Moreover, in working with some of the largest databases in enterprise-grade production systems, I've gained extensive knowledge of large-scale data processing and distributed systems—the kind relevant to developing high-volume data pipelines using incremental ETL techniques that you're requiring.
₹65,000 INR in 7 days
0.0
0.0

With over a decade of experience in projects management and software development, I've honed my abilities as a problem solver and data engineer. Specifically, I've accumulated more than five years of Python expertise, with a strong emphasis on Pandas and PySpark. Furthermore, my deep understanding of AWS (Lambda, Glue, S3, Athena, DynamoDB, ECS Fargate) aligns seamlessly with your project requirements, making me a valuable asset to building scalable systems on the platform. In relation to data processing and schema design, I bring noteworthy ETL expertise to the table. My thorough understanding of incremental ETL techniques allows me to develop and maintain high-volume data pipelines flawlessly - delivering clean, structured data that matches your unique needs. In addition, my past experience with machine learning and MLOps workflows would undoubtedly ease integration of such processes within your systems. Beyond hard skills, I offer an invaluable passion for my work. Every challenge is an opportunity to learn something new and tackle it head-on. For example, while not directly in my repertoire, I have no qualms in acknowledging Node.js as a learning curve and am more than willing to gain proficiency with it for comprehensive solutions-focused approach. Lastly, rest assured that my preference for working remotely perfectly suits your work-from-home arrangement while ensuring timely proficient output.
₹56,250 INR in 7 days
0.0
0.0

I am currently working as Data Engineer to build the ETL pipelines on metadata driven with different sources.. I have strong knowledge on databricks with pyspark and data modelling also.. I am working with big team with data driven tables in sql server with all propegations of activities.
₹66,250 INR in 7 days
0.0
0.0

I'm glad you've taken the time to consider my profile for this Senior Data Engineer position. My name is Jonathan, and I have over five years of experience developing with Python, which is crucial given the importance of this language to your project. I'm proficient in SQL, Pandas, and PySpark, and I have in-depth knowledge of AWS services. I'm familiar with Lambda, Glue, S3, DynamoDB, and ECS Fargate, and I can effectively use them to build scalable systems that meet high standards of security and performance. My core data engineering skills are complemented by my experience working in large-scale environments and building distributed systems. As someone who has developed enterprise-level production systems, I'm familiar with CI/CD pipelines and ensuring data quality and validation. For me, data engineering isn't just about understanding code; it's about creating systems that have an intrinsic impact. By adapting to the constantly evolving technological trends of AWS and MLOps with SageMaker, I can bring much more than just ETL capabilities to your team. Furthermore, my backend/API development knowledge, along with my experience in ML/MLOps workflows, will be instrumental in contributing to serverless architectures and building microservices based on them. I am also results-oriented and committed to meeting deadlines.
₹56,250 INR in 7 days
0.0
0.0

I am a freelance video editor and digital content creator with experience in creating engaging short-form content for social media platforms such as YouTube Shorts, TikTok, Facebook, and Instagram. I specialize in gaming edits, transitions, subtitles, effects, and professional-looking content designed to increase audience engagement. Beginner-Friendly Honest Version
₹56,250 INR in 7 days
0.0
0.0

A dedicated MS SQL Database Administrator with 9.5+ years of experience, Including 4+ Experience of Technical Lead. Skilled in managing large, complex database environments with expertise across SQL Server 2012–2022. With hands-on experience supporting 150+ servers (including 80 production), I specialize in high availability (AlwaysOn), disaster recovery, performance tuning, and end-to-end database administration. Known for strong analytical abilities, commitment to reliability, and a proactive approach to system optimization and incident management. Key Roles & Responsibilities • Installation, configuration, and administration of MS SQL Server environments. • Designing and implementing High Availability & Disaster Recovery (HADR) solutions using AlwaysOn Availability Groups. • Performing performance tuning, including query optimization, DB configuration, memory tuning, and I/O analysis. • Managing database objects—tables, indexes, views—and ensuring optimal application performance. • Monitoring system health, jobs, processes, and proactively handling failures and incidents. • Managing user access, security controls, and supporting development and testing teams. • Ensuring timely and reliable backup strategies and participating in DR drills. • Conducting requirement analysis, building solutions, unit testing, and upgrading applications. • Providing production support, incident management, problem resolution, and coordination with users and stakeholders
₹56,250 INR in 7 days
0.0
0.0

Hello, I am interested in the Senior Data Engineer freelance opportunity I have completed my BSc in Computer Science and have hands-on experience in web development, backend systems, database management, and building scalable applications. I have worked on projects involving Python, APIs, Firebase, dashboards, and automation-based systems. I am also currently working on AI and data-driven projects, which has strengthened my problem-solving and analytical skills. I am a quick learner, adaptable to new technologies, and comfortable working in fast-paced environments. I am interested in working with AWS-based data engineering and scalable backend architectures, and I am available for immediate joining. Please find my profile/resume attached for your consideration. I would appreciate the opportunity to discuss the role further. Regards, Ankush Ranjeet Sharma
₹37,500 INR in 7 days
0.0
0.0

Hello, I’m a Senior Data Engineer with 5+ years of experience building scalable data pipelines, cloud-native ETL systems, and event-driven architectures on AWS. I specialize in Python, SQL, and PySpark, with strong hands-on experience in Lambda, Glue, S3, Step Functions, and distributed data processing systems. In my recent work, I’ve designed incremental ETL pipelines, serverless microservices, and workflow orchestration systems focused on reliability, monitoring, and automated recovery. I also work closely with data quality, anomaly detection, and CI/CD practices to ensure production-grade stability in high-volume environments. For your role, I can contribute to building scalable multi-tenant architectures, optimizing data pipelines, and supporting ML/MLOps workflows using SageMaker and related AWS services. My approach is always practical—focus on clean architecture, cost efficiency, and systems that scale without breaking under load. I’m comfortable working in fast-paced freelance setups and delivering production-ready components on tight timelines. I’d be glad to contribute to your team and start immediately if needed.
₹55,000 INR in 7 days
0.0
0.0

Hi Team, I am interested in the Senior Data Engineer freelance opportunity (Job ID: GKS2105_4). I have 4+ years of hands-on experience building scalable data engineering, ML, and automation systems, with strong expertise in Python, SQL, AWS, Airflow, FastAPI, Kafka, ScyllaDB, and distributed data pipelines. My recent work has heavily focused on architecting production-grade data platforms, real-time processing systems, and ML-enabled backend services. Relevant experience aligned with your requirements includes: • Built AWS Lambda-based large-scale processing systems handling 150k+ articles/day with FastAPI orchestration, validation pipelines, and automated workflows • Designed Kafka-Scylla real-time ingestion pipelines processing 100k+ daily interactions with monitoring and observability using Prometheus, Loki, and AlertManager • Managed centralized data warehouse and ETL pipelines integrating voter files, survey/CAPI ingest, campaign data, and third-party data sources • Strong experience with Python, Pandas, parallel processing, REST APIs, distributed systems, and scalable backend architecture • Worked extensively on ML pipelines, MLFlow-based model lifecycle management, and production analytics systems • Experience building scalable APIs, workflow automation systems, monitoring frameworks, and data validation pipelines Regards, Prashant Vats +91-7655048808
₹75,000 INR in 30 days
0.0
0.0

Hi There, I would like to work on your project. I'm an automation specialist in the Business Intelligence (BI) domain with over 5 years of hands-on experience in BI reporting, process automation, and data visualization. I have deep expertise in Power BI, Power Automate, and Power Apps, and I'm proficient in a broad range of programming languages and platforms such as Azure Data Engineering, ADF, Alteryx, MS Excel, Google Sheets, MS Access, SAS, SQL, SSIS & SSRS, VBA, VB.NET, Python, PySpark, and R. I also bring extensive experience in working with large datasets and developing impactful visualizations using tools like Tableau, QlikView, and Power BI. Thank you!
₹56,250 INR in 7 days
0.0
0.0

Mumbai, India
Payment method verified
Member since May 13, 2026
₹37500-75000 INR
₹37500-75000 INR
₹37500-75000 INR
₹37500-75000 INR
₹37500-75000 INR
₹750-1250 INR / hour
₹12500-37500 INR
₹750-1250 INR / hour
₹150000-250000 INR
₹1500-12500 INR
₹37500-75000 INR
₹12500-37500 INR
$10-30 AUD
₹12500-37500 INR
$250-750 USD
$30-100 USD / hour
$30-250 USD
₹37500-75000 INR
₹12500-37500 INR
$250-750 USD
₹12500-37500 INR
₹100-400 INR / hour
$250-750 USD
€250-750 EUR
$25-50 AUD / hour