Lead Azure Data Engineer Job at Info Resume Edge, Atlanta, GA

dXRlM213cklyNE1zWkRsckhsNGJXejhLWUE9PQ==
  • Info Resume Edge
  • Atlanta, GA

Job Description

Key Responsibilities

  • Participate in the modernization and migration of current Azure data and analytics systems to the Databricks Lakehouse Platform .

  • Support Databricks platform enablement, configuration, and deployment activities.

  • Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Azure Functions, and Databricks.

  • Build scalable data integration solutions across Azure Data Lake, Azure SQL Database, Azure Storage (Blob/File) , and Databricks.

  • Assist in optimizing ingestion and transformation processes for performance, reliability, and cost efficiency.

  • Migrate legacy data pipelines, workflows, and processing logic into Databricks notebooks or Delta pipelines.

  • Work with cross-functional teams to understand business requirements and translate them into technical solutions.

  • Ensure all solutions comply with Marsh MMA standards for security, governance, and data quality .

  • Perform data validation, unit testing, troubleshooting, and system performance tuning.

  • Document architecture, workflows, design decisions, and operational procedures.

Required Technical Skills

  • Strong hands-on experience with:

    • Azure Data Factory (ADF)

    • SQL / T-SQL

    • Azure Functions

    • Azure SQL Database

    • Azure Data Lake (ADLS Gen2)

    • Azure Storage (Blob / File)

    • Databricks (Notebooks, Delta Lake, Spark)

Qualifications

  • Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field.

  • Proven experience working with cloud-based data engineering solutions, preferably in Azure ecosystems.

  • Experience supporting cloud migration or modernization initiatives is a plus.

  • Strong understanding of ETL/ELT concepts, data modeling, and distributed data processing.

Soft Skills

  • Strong analytical and problem-solving mindset.

  • Excellent communication and documentation abilities.

  • Ability to collaborate with cross-functional teams across technical and business domains.

  • Detail-oriented with a focus on quality and compliance.

Job Tags

Similar Jobs

CDM Smith

Environmental Engineer 2 Job at CDM Smith

 ...CDM Smith is looking for an entry-level Environmental, Water Resources, or Civil Engineer to join our Water Services Group. This position presents an excellent opportunity for early career candidates to apply their engineering skills to innovative and sustainable water... 

Williams Construction LLC

Journeyman Carpenter Job at Williams Construction LLC

We are a growing Custom Home Builder looking for Journeyman Carpenters to join our team! Located on the island of Kauai, we design and build cutting-edge homes in one of the most beautiful tropical locations in the world! What do you need to be a Journeyman Carpenter... 

Avani Healthcare Staffing

LPN Job at Avani Healthcare Staffing

 ...where YOU matter! You work hard, and you deserve an exceptional travel healthcare experience. Avani Healthcare Staffing makes it...  ...the right time. With years of experience in healthcare staffing, we're ready to find the perfect assignment and destination for you.... 

Environmental Resources Management (ERM)

Remote Junior Civil/Environmental Engineer - Hybrid Growth Job at Environmental Resources Management (ERM)

A global environmental consultancy in Minneapolis is seeking an entry-level Engineer to support civil and environmental projects. This hybrid position involves working on site/civil design, stormwater management, and collaborating with a diverse team. Candidates with a... 

Cloud Analytics Technologies LLC

ETL/Informatica Data Engineer Job at Cloud Analytics Technologies LLC

 ...various bank applications for use by analysts, modelers, etc. Analysis and validation of data Testing and implementing new data sources Must Have Technical Skills: ETL SQL Flex Skills/Nice to Have: Spark Soft Skills: Collaboration Data Driven...