Azure Databricks Administrator

Role: Azure Databricks Administrator Location: Remote Duration: Contract through end of March (firm end date) We are seeking an experienced Azure Databricks Administrator to manage, maintain, secure, and optimize Databricks environments in Azure. This role is focused on platform administration, governance, operational support, performance, reliability, and cost efficiency across the organization’s data analytics infrastructure. The successful candidate will serve as a platform administrator and operational partner to data engineering, analytics, cybersecurity, compliance, and business teams, helping ensure Databricks is reliable, well-governed, secure, and effectively supported. What You'll Do Configure, maintain, and administer Azure Databricks workspaces and clusters across development, staging, and production environments. Monitor cluster health, performance metrics, resource utilization, and platform availability. Optimize cluster, SQL warehouse, and workspace configurations for performance and cost efficiency. Manage workspace governance, including job scheduling, notebook organization, audit logging, and operational standards. Administer user access, workspace permissions, SQL warehouse configurations, and group-based security controls. Troubleshoot infrastructure issues, performance bottlenecks, connectivity problems, and workload failures. Support disaster recovery and high-availability planning, validation, and operational readiness for Databricks workloads. Collaborate with data engineering teams to establish Databricks usage standards, support workload reliability, troubleshoot platform issues, optimize Delta Lake performance, and promote governed platform adoption. Administer and enforce security policies, RBAC, encryption standards, and access controls. Maintain documentation and runbooks for operational procedures. Support capacity planning, cost optimization, and platform improvement initiatives. Security Governance Maintain security governance standards for Azure Databricks in a financial services environment, including RBAC, least-privilege access, privileged access controls, and group-based permissions. Administer Unity Catalog permissions, metastore access, catalogs, schemas, tables, volumes, and external locations to enforce governed data access. Manage workspace permissions, admin roles, service principals, groups, SCIM provisioning, and Microsoft Entra ID integration to support secure identity governance. Configure and review compute policies, cluster permissions, instance pool access, SQL warehouse permissions, and job ownership to reduce unnecessary privilege and control platform usage. Oversee secrets management, token usage, storage credential access, and Key Vault-backed configurations to protect sensitive financial, customer, and operational data. Coordinate recurring access reviews, access certification, and timely remediation of excessive, inappropriate, or outdated permissions to support internal control…