Data Engineer
Padmore Global Connections LLC · Atlanta, Georgia, United States · On-site
Sign up free: we match you to jobs like this, tailor your application and fill the form. 2 free applications every day.
Work Arrangement: Hybrid
Agency Interview Type: Either Web Cam or In Person
Engagement Type: Contract
NOTE : Applications with resumes in PDF Format will be automatically rejected. Only Word format resumes will be considered.
Short Description:
Under general supervision, combines strong technical skills with knowledge of the database administration. Works on one or more projects of high complexity.
Complete Description:
The Dept. of Early Care & Development (DECAL) is seeking a highly skilled and proactive Data Engineer to join our dynamic team and support the modernization of our data estate. This role is integral to the migration from legacy systems and the development of scalable, secure, and efficient data solutions using modern technologies, particularly Microsoft Fabric and Azure-based platforms. The successful candidate will contribute to data infrastructure design, data modeling, pipeline development, and visualization delivery to enable data-driven decision-making across the enterprise.
Work Location & Attendance Requirements:
Must be physically located in metro Atlanta.
On-site: Tuesday to Thursday, per managers discretion
Mandatory in-person meetings:
o All Hands
o Enterprise Applications
o On-site meetings
o DECAL All Staff
Work arrangements subject to managements discretion
Experience Required: 5+ years
Key Responsibilities:
Design, build, and maintain scalable ETL/ELT data pipelines using Microsoft Fabric and Azure Databricks.
Implement medallion architecture (Bronze, Silver, Gold) to support data lifecycle and data quality.
Support the sunsetting of legacy SQL-based infrastructure and SSRS, ensuring data continuity and stakeholder readiness.
Create and manage notebooks (e.g., Fabric Notebooks, Databricks) for data transformation using Python, SQL, and Spark.
Build and deliver curated datasets and analytics models to support Power BI dashboards and reports.
Develop dimensional and real-time data models for analytics use cases.
Collaborate with data analysts, stewards, and business stakeholders to deliver fit-for-purpose data assets.
Apply data governance policies including row-level security, data masking, and classification in line with Microsoft Purview or Unity Catalog.
Ensure monitoring, logging, and CI/CD automation using Azure DevOps for data workflows.
Provide support during data migration and cutover events, ensuring minimal disruption.
Technical Stack:
Microsoft Fabric
Azure Databricks
SQL Server / SQL Managed Instances
Power BI (including semantic models and datasets)
SSRS (for legacy support and decommissioning)
Qualifications:
Bachelors degree in Computer Science, Information Systems, or related field
5+ years of experience in data engineering roles, preferably in government or regulated environments
Proficiency in SQL, Python, Spark.
Hands-on experience with Microsoft Fabric (Dataflows, Pipelines, Notebooks, OneLake)
Experience…