Senior Data Integration Engineer (Python, Databricks, Spark SQL)
EPAM Systems
Software Engineering, Other Engineering
Kiev, Ukraine
Posted on Wednesday, March 13, 2024
Senior Data Integration Engineer (Python, Databricks, Spark SQL) Description
DESCRIPTION
Our client is a global, privately owned company that connects people with ideas, data with insights, supply with demand, restaurants with deliveries and ultimately, people with the products they love.
Responsibilities
- Implementation of DWH and Data Hubs, including the full ETL process
- Implementation of Data Models
- Unit Testing
Requirements
- Experience building data ingestion pipelines with tools like: Databricks, SSIS, Talend, Informatica, etc
- Experience implementing data models that have been designed by someone else
- Strong SQL – The plan is to have the data engineers create Databricks notebooks using either SQL or Python, but SQL is preferable
- Experience unit testing code
- Upper-Intermediate level of English, both spoken and written (B2+)
Nice to have
- Azure/other cloud storage technologies, SSAS tabular, Azure Data Factory, Azure DevOps
We Offer
- Competitive compensation depending on experience and skills
- Individual career path
- Unlimited access to LinkedIn learning solutions
- Sick leave and regular vacation
- English classes with certified English teachers
- Flexible work hours