Lead Data Software Engineer
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Data Software Engineer" FinTech Australia.Software Engineering
Portugal
Posted 6+ months ago
Lead Data Software Engineer Description
DESCRIPTION
As a Data Software Lead, you will design, develop, and maintain data systems and solutions. You will collaborate with cross-functional teams to ensure data integration, quality, and security.
We are looking for a hands-on and lead data software engineer focused on Azure Data stack (Databricks) to join our growing Data Practice.
Responsibilities
- Lead modern data platforms implementation starting from requirements identification and up to production releases
- Design and develop highly scalable, maintainable and data centric solutions using Azure cloud and Databricks
- Design, create, optimize and maintain EL/ETL/ELT data pipelines and orchestration processes
- Design, create, optimize and maintain data models
- Ensure data quality processes, monitoring and data cleansing
- Contribute to data governance activities
- Collaborate with cross-functional teams to integrate data into various systems and applications
- Drive and facilitate direct communication with project sponsors and business stakeholders
Requirements
- Azure Data stack experience: Databricks, Data Lakehouse, Delta Lake, ADF, ADLS, Apache Spark, SQL/NoSQL, Key vault
- Strong experience with Python, PySpark
- Strong understanding of data processing design patterns: EL, ETL, ELT, incremental/delta loads and data streaming (optional)
- Strong knowledge of RDBMS, data marts and Lakehouse design concepts
- Ability to support infrastructure, security, network, and data exchange and distribution topics
- Ability to work collaboratively with cross-functional teams
- Excellent problem-solving skills and attention to detail
- Upper-Intermediate level of English, both spoken and written (B2+)
We Offer
- Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Data Software Engineer" FinTech Australia.