We are seeking a Senior Data Integration Engineer with 6+ years of experience to lead the integration of data from a new vendor-managed SaaS operational system into our Azure Synapse environment.

Responsibilities

• Design and implement data pipelines for SaaS platform integration into Azure Synapse
• Build and optimize ETL/ELT pipelines using Azure Data Factory and Synapse
• Develop and manage Delta Lake architectures following Medallion principles
• Utilize Azure Data Lake Gen2 for storage and manage Delta Lake features
• Optimize data transformations and queries using SQL Serverless, Apache Spark, PySpark, and Spark SQL
• Implement and monitor workflows to maintain system reliability
• Synchronize data between Dynamics 365 and Azure Synapse
• Apply CI/CD principles for pipeline deployment with Git
• Collaborate with stakeholders to align solutions with business needs

Requirements

• 6+ years’ experience in data integration
• Proficiency in Kimball Methodologies for data modeling
• Expertise in Azure Synapse, Data Factory, and Data Lake Gen2
• Strong understanding of Delta Lake and Medallion Lakehouse architecture
• Advanced SQL and Apache Spark skills
• Proficiency in PySpark, Spark SQL, and data formats like .parquet, .delta, and .json
• Experience with CI/CD pipelines and Git

Nice to have

• Knowledge of Azure Fabric components
• Power BI dataset and report development
• Understanding of DAX for data analysis

We offer

• By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

- We are a leading global provider of digital platform engineering and development services that has rapidly grown in Australia since 2013.

- We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.

- You will work in an open and friendly work environment where your professional skills and experience can stand out.

How We Hire

• Here, we summarize the typical journey to finding a job within EPAM.

• Apply and tell us about yourself!

• Go through some standard interviews:

• - General interview with a recruiter
• - Technical interview with our technology experts
• - Manager interview or Offer interview with a hiring manager

• Get ready to join the team!

• Not sure if you meet all the requirements? No problem. Let's talk anyway and find out more!

• It takes 1 min of application to start the journey with us. Apply now!