Senior Data Engineer
EPAM Systems
Senior Data Engineer Description
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Our Engineering Enablement Department has a purpose to accelerate our teams worldwide. We strive to provide teams with a set of tools and services to enable them to unlock their full potential. In short, we enable them to deliver quality customer value quickly and autonomously. The tools and services we provide are built with and for our engineering community.
As a Senior Data Engineer, you will be responsible for developing and maintaining a data platform designed to provide compliance automation insights and developer experience metrics. You will onboard different data sources in our platform and build pipelines to automatically transform these to clean data sources. You help in translation abstract items from the DevOps framework to actual measurable metrics.
Responsibilities
- You build and maintain our Cloud products, technical platforms, or paved roads with state-of-the-art technology
- You leverage your specialist knowledge of your field to help decide the best technical architecture and solutions for our complete organization
- You are a part of the larger enablement community and help us improve every day
- You work with an “open-source and build yourself” mentality in a corporate environment
- Designing and developing ETL solutions using DBT, Databricks and Python
- Utilizing Python, and Terraform to automate database-related tasks
- Managing and optimizing database performance, security, and availability
- Collaborating with the development team to understand data requirements and ensure optimal data integration
- Creating and maintaining technical documentation related to database systems
Requirements
- Minimum of Senior Data Engineer experience, with experience working in a cloud environment (Azure)
- Develop and maintain a data platform in Databricks designed to provide compliance automation insights and developer experience metrics
- Proficient in using ETL solutions
- Experience with DBT, Python, SQL, Terraform
- Proactive with a compliance / audit mindset
- Excellent command of English at a B2 level
- Integrate new data sources (test automation results, deployments, vulnerabilities)
- You have a good understanding of data engineering, data warehousing and software development
- Nice to have experience with Go
We offer
- We believe that the greatest strength of the company is its people. EPAM is fully committed to help its employees to reach their full potential and achieve their professional goals through continues learning. With this in mind, we would like to introduce to you few of the many opportunities and services which we believe will help you expand your current knowledge
- Full access to cutting-edge tools and technologies
- Competitive compensation depending on experience and skills
- All-around Social package: professional & soft skills training, medical & family care programs, sports
- Relocation opportunities
- Free English classes
- Unlimited access to LinkedIn learning solutions
- Continuous experience exchange with experts and professionals worldwide
- Friendly team and comfortable working environment
- Engineering, corporate, and social events within and outside the Company
- Flexible working schedule
- Opportunities for self-realization