Data Architect (Microsoft Fabric & Azure Databricks)
Padmore Global Connections LLC · Atlanta, Georgia, United States · On-site
Sign up free: we match you to jobs like this, tailor your application and fill the form. 2 free applications every day.
Interview Type : Either Web Cam or In Person
Work Arrangement : Hybrid
Engagement Type : Contract
Short Description:
Supervises the coordination of design and security for computer databases to store, track, and maintain a large volume of critical business information.
Complete Description:
Job Description: Data Architect - Microsoft Fabric & Azure Databricks
The Department of Early Care & Learning (DECAL) is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks for integration with state-level systems. This role will focus on creating scalable data architecture that enables seamless data flow between IES Gateway and our analytics platform. The ideal candidate will have deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake architecture.
Work Location & Attendance Requirements:
Must be physically located in Georgia
On-site: Tuesday to Thursday, per manager's discretion
Mandatory in-person meetings:
o All Hands
o Enterprise Applications
o On-site meetings
o DECAL All Staff
Work arrangements subject to management's decision
While the intent may be a long-term tenure, this position is subject to annual budget restrictions. The initial contract is through the end of this fiscal year and is anticipated to be renewed July 1st.
Key Responsibilities:
Data Architecture:
· Design end-to-end data architecture leveraging Microsoft Fabric's capabilities.
· Design data flows within the Microsoft Fabric environment.
· Implement OneLake storage strategies.
· Configure Synapse Analytics workspaces.
· Establish Power BI integration patterns.
Integration Design:
· Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
· Design Delta Lake architecture for IES Gateway data.
· Implement medallion architecture (Bronze/Silver/Gold layers).
· Create real-time data ingestion patterns.
· Establish data quality frameworks.
Lakehouse Architecture:
· Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance.
Data Governance:
· Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance.
Implement row-level security.
· Configure Microsoft Purview policies.
· Establish data masking for sensitive information.
· Design audit logging mechanisms.
Pipeline Development:
· Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration.
Performance Optimization:
· Implement performance tuning strategies for large-scale data processing and analytics workloads.
· Optimize Spark configurations.
· Implement partitioning strategies.
· Design caching mechanisms.
· Establish monitoring frameworks.
Security Framework:
Design and implement security…