Senior Data Engineer
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data Engineer" FinTech Australia.Data Science
Czechia
Posted on Friday, February 23, 2024
Senior Data Engineer Description
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are looking for a Senior Data Engineer to make a team even stronger.
DESCRIPTION
We are looking for a Senior Data Engineer to make a team even stronger.
Responsibilities
- Develop, monitor, and operate the most used and most critical curated data pipeline - Sales Order Data (incl. Post-order information, e.g. shipment, return, payment). This pipeline is processing hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases
- Consulting with analysts, data scientists, and product managers to build and continuously improve "Single Source of Truth" KPI for business steering such as the central Profit Contribution measurement (PC II)
- Leverage and improve a cloud-based tech stack that includes AWS(Azure), Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Requirements
- Expertise in Apache Spark along with Spark streaming & Spark SQL
- Good hands on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Good understanding & hands-on experience with CI/CD
- Rich working experience with Github
- Fluency working with any cloud (AWS, Azure, GCP) landscape
- Ability to build Apache Airflow pipelines
We Offer
- Opportunity to work in a fast-paced, agile, software engineering culture
- English-speaking environment
- Unlimited access to LinkedIn learning solutions
- Comfortable modern offices in Prague 4 or remote work from any location in Czech Republic
- Benefit program (5 weeks of vacation, paid sick days, paid days off for special occasions, meal vouchers, flexi pass, Prague city public transport annual coupon, multisport cards, contribution to pension fund, health insurance for family member)
- English language courses
- Czech language courses upon request
- Relocation assistance
- Rotation program - possibility to relocate for short and long-term projects within 30 countries
- Referral bonuses for recommended candidates
- Mobile Phone Tariff’s program for managerial level candidates
- EPAM Employee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)
- Some of these benefits may be available only after you have passed your probationary period
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data Engineer" FinTech Australia.