Azure Data Engineer Needed in Pune

@Web1devloper

As an experienced Data Engineer, I am confident in my capacity to tackle your project's exciting demands. Over the past 8+ years, I have honed my expertise in a wide range of tools and technologies, including Azure Databricks, PySpark, SQL Server, Azure Data Factory and more - precisely the set of skills you're searching for. Not only knowledgeable in handling complex datasets, but I also bring profound insights into the Healthcare and Insurance domain that will add value to your work. Having successfully built and optimized ETL/ELT processes using Azure Data Lake Storage Gen2 (ADLS Gen2), processed historical and incremental data, performed delta MERGE/Upsert operations, parsed and transformed complex JSON data; I can ensure efficient transformations and maintain robust Delta Lake tables for your projects. My proven expertise will come handy in enhancing performance on Spark/Databricks platforms as well. Additionally, my hands-on experience with Member, Claims, Policy, Benefits, FHIR or HL7 data aligns directly with your specific requirements. This unique perspective ensures I can smoothly process data from SQL Server and other relevant sources while guaranteeing the highest level of quality from source-to-target.

@ihsan191

Hello there, I am excited about the opportunity to work as a part-time Azure Data Engineer on your project in Pune. With extensive experience in Azure Databricks, PySpark, and SQL Server, I am well-equipped to develop and troubleshoot Databricks notebooks while building and modifying Azure Data Factory pipelines to effectively process data from various sources. My background includes working with Delta Lake, implementing MERGE/Upsert logic, and performing data transformation and deduplication. Additionally, I have a solid understanding of JSON and nested JSON processing, which will be crucial for your data requirements. My experience in the healthcare domain, specifically with member, claims, and policy data, allows me to deliver tailored solutions that meet industry standards. For this project, I propose a collaborative approach where we can define specific milestones and goals. By working closely together, I can ensure that the data processes are optimized and aligned with your vision. I would love to discuss how my skills can contribute to the success of your project. Thank you for your time, Ihsan.

@TechWagger2026

With a robust skill set that aligns directly with your Azure Data Engineer needs, I would be an invaluable addition to your project. As a data-processing maestro, I have a demonstrated command in Azure Databricks, PySpark, SQL; enabling me to efficiently build and troubleshoot ADF pipelines and process data from varied sources like SQL Server. Perhaps most pertinently to your project, I have hands-on experience in historical and incremental data processing alongside an extensive understanding of Delta Lake and JSON transformations—skills that are paramount for your nested JSON data parsing aims. Moreover, I recognize the value of real-world context thus my experience in the Healthcare and Insurance domains would prove beneficial. Having worked extensively with Member, Claims, Policy, Benefits, FHIR or HL7 data, I am well-positioned to help you utilize the available healthcare data resources meaningfully. Finally, as part of TechWagger we bring forth our commitment towards innovation, transparency and on-time delivery ensuring scalability & security of all systems. With a proven track record in delivering scalable and secure digital products tailored specifically to client requirements - both efficient in terms of time & resources- We believe we will be able to replicate the same efficiency for you in Pune. I look forward to discussing with you how my skills can best serve your project.

@michela542

Hi, I have developed several Azure data engineering and analytics solutions using Azure Databricks, PySpark, Python, SQL Server, Azure Data Factory, ADLS Gen2, Delta Lake, and Power BI. ? The main challenge is building reliable historical and incremental data pipelines while keeping Delta tables accurate through MERGE, deduplication, validation, and reconciliation. ✅ In similar data engineering projects, I worked with ADF pipelines, ADLS Gen2 landing areas, Azure SQL, Databricks notebooks, PySpark transformations, and Delta Lake. I handled full and incremental loads, source-to-target validation, duplicate removal, Delta MERGE/Upsert logic, SQL transformations, and nested JSON processing. I also troubleshoot Spark jobs and optimize transformations, partitioning, and data movement where required. ✅ I can work on SQL Server ingestion, ADF pipeline changes, PySpark notebooks, historical and incremental processing, Delta table maintenance, nested JSON transformation, deduplication, and reconciliation between source and target datasets. I also have experience with healthcare analytics involving patient, appointment, billing, pharmacy, and laboratory data. With this kind of experience, I can contribute to implementing your Azure data engineering requirements. Looking forward to discussing your project with you. Best regards Michel

@NEHABHAT92

With over a decade of hands-on experience in the IT industry, I strongly believe that my skill set is the perfect fit for your Azure Data Engineering project. My proficiency with Python, Azure Databricks, PySpark, SQL Server, and other tools you mentioned aligns with your project's requirements. Being adept in ETL/ELT and having an understanding of historical and incremental data processing, my contributions would be highly valuable. My professional domain exposure includes healthcare and insurance, which positions me well to understand and handle sensitive data related to Members, Claims, Policy, Benefits, FHIR or HL7. Furthermore, I've also got a good grasp on JSON and nested JSON processing basics as required by you. Additionally, as part of my development journey, I've had the opportunity to enhance my problem-solving skills effectively. Succeeding in this project will only grant me more opportunities for growth in my own company. Given the chance to work with you on this part-time stint using agile methodologies tradecraft in Pune, I ensure quality work and efficient completion of deliverables. Therefore, I humbly submit my bid for your consideration.

@abhilashr53

You need a hands-on Azure Data Engineer who can sit beside you in Pune, hit the ground running on Delta Lake pipelines, and deliver clean, validated data without a steep onboarding curve. That is exactly what I do. My approach: I will start by understanding your source systems and target schema in session one, then build medallion-layer Delta Lake tables in Databricks with PySpark, wire ADF pipelines for both historical full loads and incremental ingestion, implement MERGE/Upsert logic for deduplication, and handle nested JSON flattening systematically. Source-to-target reconciliation checks will be built in, not bolted on afterward. Stack I will use: Azure Databricks, PySpark, ADF, ADLS Gen2, Delta Lake, SQL Server, Python utilities for JSON parsing and data quality assertions. I have worked extensively with healthcare-style data structures including Member, Claims, and Policy entities, so the domain context will not slow us down. Risk I will handle proactively: schema drift in incremental loads and Spark partition skew, both addressed during initial design rather than discovered later. Timeline: productive from day one, full pipeline coverage within the first two weeks of part-time sessions. One question before we confirm: are your source SQL Server tables CDC-enabled, or will we implement watermark-based incremental extraction?

@GenomyR

Hi, Processing nested JSON and handling incremental upserts in Azure Databricks requires robust PySpark pipelines to prevent state drift, especially with complex healthcare claims data. I will build modular ADF orchestration pipelines feeding into ADLS Gen2, utilizing Delta Lake and optimized PySpark notebooks for reliable incremental loads and source-to-target reconciliation. This scope will take 2 business days for the initial pipeline architecture setup. Are the incoming SQL Server and JSON sources currently streaming or landing in batches, and what is the expected volume for the initial historical load? Best regards, Tumisang

@hadimri

Hello, Regarding your project "Azure Data Engineer Needed Pune" — here is exactly how I would deliver it. I can consolidate your Excel workbooks into one master file, line by line, without disturbing existing formulas, and prove the totals tie out. - Every line item / code / description / amount carried across exactly as it appears. - A reconciliation pass before hand-off: each source total vs the consolidated block and the grand total — you get the file only once the difference is zero, with a short sheet showing every source total next to the consolidated total. Turnaround: 3 days from receiving the files. Same-day turnaround on any revision. Deterministic process — same input, same output, every run — no manual retyping, no guessing; anything ambiguous is flagged for your decision, never changed silently. Thank you for considering my bid.

@wataakal

I recently helped a client transform their data processing workflows using Azure technologies, resulting in a streamlined system that improved efficiency and accuracy. I can do the same for your project in Pune, leveraging my expertise in Azure Databricks, PySpark, and SQL. I will develop robust data pipelines, implement ETL processes, and ensure seamless data transformation and validation tailored to your specific needs. With a focus on performance optimization and hands-on collaboration, I’ll keep you updated and engaged throughout the project. My experience in healthcare data, including FHIR and HL7, gives me an edge in understanding the nuances of your requirements. With 75+ 5-star reviews and a top 1% ranking among 75 million users, you can trust that I deliver results. If you’re looking for a skilled Azure Data Engineer to elevate your project, I’d be excited to work with you. Regards, Wataaka

@nabeeli18

Greetings I understand you're looking for a part-time Azure Data Engineer in Pune, and I have successfully completed similar projects. Your project requires expertise in Azure Databricks, PySpark, and SQL, along with a strong focus on data processing and transformation. I can help streamline your data workflows and ensure efficient handling of historical and incremental data. My approach will enhance data validation and reconciliation processes, ensuring high-quality outputs tailored to your needs. I bring extensive experience in data engineering, particularly with Azure technologies, and have worked on projects within the healthcare sector, focusing on Member and Claims data. This background equips me to address your specific requirements effectively. I'd love to chat about your project and suggest a follow-up discussion to explore how we can work together. Regards, Nabeel Ismail

@guptakishan805

Being a passionate and experienced Full Stack Developer with a strong foundation in Azure, my skillset and expertise can cater precisely to your needs. I have completed several projects using Azure Data Factory, Azure Databricks, and Delta Lake, which align with the technical requirements you have outlined. In addition, my advanced knowledge of PySpark and SQL will ensure efficient data processing and transformation in your project. Moreover, I have experience working on projects in the healthcare domain which further solidifies my compatibility with your venture. Handling Member, Claims, Policy, Benefits, FHIR or HL7 data is not a problem for me. I understand the importance of accurate data handling and aim to provide optimal source-to-target data validation and reconciliation for improved project performance. In past projects, I have demonstrated my ability to identify shortcomings and optimize Spark/Databricks performance which will be crucial for your historical and incremental data processing requirements. My goal is always to exceed client expectations by delivering reliable solutions. I am confident that with my skills and commitment to comprehensive understanding of client's needs, we can achieve tremendous success together.