Senior Data DevOps Engineer with Azure, Databricks
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data DevOps Engineer with Azure, Databricks" FinTech Australia.Software Engineering
Ukraine
Posted on Monday, May 27, 2024
Senior Data DevOps Engineer with Azure, Databricks Description
We are looking for a Senior Data DevOps to join EPAM and contribute to a project for a large customer
As a Senior Data DevOps in Data Platform, you will focus on maintaining and implementing new features to the data transformation architecture, which is the backbone of the Customer's analytical data platform. As a key figure in our team, you'll implement and deliver high-performance data processing solutions that are efficient and reliable at scale
As a Senior Data DevOps in Data Platform, you will focus on maintaining and implementing new features to the data transformation architecture, which is the backbone of the Customer's analytical data platform. As a key figure in our team, you'll implement and deliver high-performance data processing solutions that are efficient and reliable at scale
Responsibilities
- Design, build and maintain highly available production systems utilizing Azure data solutions including Data Lake Storage, Databricks, ADF, and Synapse Analytics
- Design and implement build, deployment, and configuration management systems together with CI/CD experience improvements based on Terraform and Azure DevOps pipeline solutions across multiple subscriptions and environments
- Improving users experience with Databricks platform based on best practices of Databricks cluster management, cost-effective setups, data security models etc
- Design, implement and improve monitoring and alerting system
- Collaborate with Architecture teams to ensure platform architecture and design standards align with support model requirements
- Identify opportunities to optimize platform activities and processes, implement automation mechanisms to streamline operations
Requirements
- 4 years of professional experience
- 2 years hands-on experience with a variety of Azure services
- Proficiency in Azure data solutions including Data Lake Storage, Databricks, ADF, and Synapse Analytics
- Solid Linux/Unix systems administration background
- Advanced skill in configuring, managing and maintaining networking on Azure cloud
- Solid experience in managing production infrastructure with Terraform
- Hands-on experience with one of the Azure DevOps/GitLab CI/GitHub Actions pipelines for infrastructure management and automation
- Hands-on experience with Databricks platform
- Practical knowledge of Python combined with SQL knowledge
- Hands-on experience in one scripting language: Bash, Perl, Groovy
- Advanced skill in Kubernetes/Docker
- Good knowledge of Security Best Practices
- Good knowledge of Monitoring Best Practices
- Good organizational, analytical and problem solving skills
- Ability to present and communicate the architecture in a visual form
- English language – ability to direct communicate with customer. B2 level is required
We Offer
- Competitive compensation depending on experience and skills
- Individual career path
- Unlimited access to LinkedIn learning solutions
- Sick leave and regular vacation
- English classes with certified English teachers
- Flexible work hours
About EPAM
- EPAM is a leading global provider of digital platform engineering and development services. We are committed to positively impacting our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to learn and grow continuously. You will join a dedicated, creative, and diverse community that will help you discover your fullest potential. EPAM is committed to providing our global team of 54,600+ EPAMers with inspiring careers. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success, and we value collaboration, try always to understand our customers' business, and strive for the highest standards of excellence
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data DevOps Engineer with Azure, Databricks" FinTech Australia.