Azure Data Engineer Job at 2T Consulting, Doraville, GA

  • 2T Consulting
  • Doraville, GA

Job Description

We are seeking an experienced Technology Lead / Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics and PySpark. The ideal candidate will have a deep understanding of Apache Spark, distributed data processing, Data Lake architecture, and modern data engineering practices.

Must-Have Skills
  • Azure Synapse Analytics
  • PySpark
  • Apache Spark architecture
  • Spark SQL
  • Data Lake architecture
  • Medallion Architecture
  • Data transformation and processing
  • Strong troubleshooting and problem-solving skills
Nice-to-Have
  • Microsoft Fabric
  • Experience with modern cloud data platforms
Responsibilities
  • Design, develop, and optimize data solutions using Azure Synapse Analytics.
  • Develop scalable data pipelines and transformations using PySpark and Spark SQL.
  • Apply Apache Spark architecture and distributed processing concepts to large-scale data workloads.
  • Design and implement Data Lake and Medallion Architecture solutions.
  • Troubleshoot performance, data quality, and pipeline-related issues.
  • Collaborate with cross-functional teams to understand requirements and deliver scalable solutions.
  • Evaluate and leverage Microsoft Fabric capabilities where appropriate.
  • Provide technical leadership and contribute to solution architecture and development standards.
Required Qualifications
  • 8+ years of experience in data engineering, cloud platforms, or related technology roles.
  • Strong hands-on experience with Azure Synapse Analytics.
  • Strong programming experience with PySpark and Spark SQL.
  • Deep understanding of Apache Spark and distributed data processing.
  • Experience designing and implementing Data Lake architectures.
  • Excellent communication and collaboration skills.
  • Strong analytical, troubleshooting, and problem-solving abilities.

Job Tags

Similar Jobs

Carle Health

Assistant Counsel - Litigation Job at Carle Health

Overview The Risk Management department of Carle Health provides enterprise risk management, insurance and claims management services to entities within Carle Health ("Carle"). As part of a team of professionals, the Assistant Counsel: Litigation represents the interests...

Goodwin Recruiting

Restaurant Director of Operations Job at Goodwin Recruiting

 ...Lead Multiple Restaurants. Develop Great Leaders. Drive Results. A growing, successful restaurant group is seeking a polished Director of Operations to oversee multiple high-volume, full-service restaurants in the Charlotte market. This confidential opportunity is... 

Capital One

Manager, Project Manager Job at Capital One

 ...Manager, Project Manager As a Manager Project Manager at Capital One, you will drive strategy...  ...to mitigate risk and to be delivered on time. Leveraging problem solving and influencing...  ...the time of this posting. Salaries for part-time roles will be prorated based upon... 

Wayfair

Warehouse Equipment Operator Job at Wayfair

 ...hrly | Shifts : Multiple Shifts Available About the Role: Your Impact As a Warehouse Associate - Equipment Operator at Wayfair, you are the engine of our logistics network, directly responsible for ensuring our customers receive their orders quickly and in... 

Ngcompanies

CCTV Operator Job at Ngcompanies

Description We are seeking a skilled and detail-oriented Video Pipe Inspection Operator to join our team. The primary responsibility of this role is to operate specialized equipment to inspect pipelines, sewer systems, and other underground utilities using remotecontrolled...