Senior Data Engineer (Scala, Databricks)
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data Engineer (Scala, Databricks)" FinTech Australia.Data Science
Remote
Posted 6+ months ago
Senior Data Engineer (Scala, Databricks) Description
We are looking for a seasoned Senior Data Engineer with a passion for making a significant impact in the dynamic world of fashion e-commerce to join the Data team at our client, renowned as a top-tier fashion e-commerce platform.
As a member of our Data team, you'll be instrumental in revolutionizing PL/SQL logic with Databricks using Scala/Spark and delta live tables, driving innovation and efficiency in data processing.
This fully remote role offers the flexibility to work from any location in Poland, whether it's your home or one of our well-equipped offices in Gdansk, Katowice, Krakow, Lodz, Warsaw, or Wroclaw.
Join us in this transformative journey and be a catalyst for change!
#Data
#Data-Fashion-Tech
SEE YOURSELF IN THIS ROLE
As a member of our Data team, you'll be instrumental in revolutionizing PL/SQL logic with Databricks using Scala/Spark and delta live tables, driving innovation and efficiency in data processing.
This fully remote role offers the flexibility to work from any location in Poland, whether it's your home or one of our well-equipped offices in Gdansk, Katowice, Krakow, Lodz, Warsaw, or Wroclaw.
Join us in this transformative journey and be a catalyst for change!
#Data
#Data-Fashion-Tech
What You’ll Do
- Develop, monitor, and operate the most utilized and critical curated data pipeline - Sales Order Data (including Post-order information, e.g., shipment, return, payment). This pipeline processes hundreds of millions of records to furnish high-quality datasets for analytical and machine learning use-cases
- Collaborate with analysts, data scientists, and product managers to construct and continually enhance "Single Source of Truth" KPIs for business steering, such as the central Profit Contribution measurement (PC II)
- Leverage and refine a cloud-based tech stack encompassing AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
What You Have
- Expertise in Apache Spark along with Spark streaming & Spark SQL
- Substantial hands-on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Good understanding & hands-on experience with CI/CD
- Rich working experience with Github
- Proficiency in navigating the AWS landscape
- Ability to build Apache Airflow pipelines
- Knowledge or experience with Presto, Superset, Starburst, and/or Exasol will be a plus
We Offer
- We gather like-minded people:
- Friendly team and enjoyable working environment
- Engineering community of industry’s professionals
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Relocation within our 50+ offices
- We provide growth opportunities:
- Outstanding career roadmap
- Leadership development, career advising, soft skills and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning
- Language classes on English and Polish for foreigners
- We cover it all:
- Stable income (Employment Contract)
- Participation in the Employee Stock Purchase Plan
- Referral bonuses
- Benefits package (health insurance, multisport, shopping vouchers)
- Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and many more
- Corporate and social events
- We may contact chosen candidates only
About EPAM
- EPAM Systems Inc. (EPAM) is a leading digital transformation services and product engineering company. Since 1993, we have used our software engineering expertise to become a leading global provider of digital engineering, cloud and AI-enabled transformation services, as well as a leading business and experience consulting partner for global enterprises and ambitious startups. We address our clients’ transformation challenges by fusing EPAM Continuum’s integrated strategy, experience and technology consulting with our 30+ years of engineering execution to speed our clients’ time to market and drive greater value from their innovations and digital investments. Learn more at www.epam.com
Why EPAM
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data Engineer (Scala, Databricks)" FinTech Australia.