In this role, you will primarily engage with Databricks, Unity Catalog, SQL, Python, and CI/CD tools. The focus is on crafting and implementing trusted access and governance frameworks, elevating audit logging traceability, and merging efforts with domain experts to forge innovative data solutions.

#LI-DNI

Responsibilities

Implement and sustain Databricks Unity Catalog with detailed authorization settings for global access management
Deploy traceable and auditable data access systems using advanced platform logging techniques
Automate recurrent data-related tasks using CI/CD pipelines
Facilitate seamless integration with other development teams
Design, construct, and manage Python and SQL code for trustworthy data access solutions
Engage with domain experts to incorporate business logic into solution designs

Requirements

3+ years of experience in Data DevOps
Proficiency in Databricks, Unity Catalog, SQL, Python
Hands-on proficiency in using CI/CD tools, with a preference for Azure DevOps
Understanding of Azure Data Platform and fundamental cloud concepts including data storage, compute, and security
Knowledge in design patterns, microservice architecture, network authentication, security systems
Familiarity with managing large-scale data projects and adherence to data engineering best practices
Effective teamwork capabilities for smooth implementation coordination
Capability to devise solutions meeting business needs and ensuring compatibility with existing systems
Collaboration skills with domain specialists to embed business logic into designs
Agile and Scrum methodology experience
Strong communication skills for effective stakeholder engagement
Proactive and service-oriented mindset with a focus on continuous improvement