Lead Data Engineer with Azure
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Data Engineer with Azure" FinTech Australia.Data Science
Lithuania
Posted 6+ months ago
Lead Data Engineer with Azure Description
Description
We seek a professional to join the team responsible for Data Engineering, including designing, developing, and creating data products to help commercial data and analytics products. You will drive the entire software development lifecycle process to support continuous data delivery while leading the evaluation and adoption of emerging technologies.
This role combines technical and people management skills for the data platform that requires knowledge of big data processing and management and cloud-based data warehouse solutions.
What You’ll Do
- Provide partnership and support to SMEs and Tech Leads to ensure delivery of commitments
- Build and maintain secure and compliant production data processing pipelines by using different tools and techniques (cloud services, Python / Scala)
- Ensure that data pipelines and stores are high-performing, efficient, organized, and reliable, given business requirements and constraints
- Design, implement, monitor and optimize data platforms to meet the data pipeline needs
- Design and implement data engineering, ingestion, and curation functions on Azure cloud using Azure native or custom programming
- Create data transformation and loading workflows
- Design and operationalize large-scale enterprise data solutions and applications using one or more Azure data and analytics services
- Implement data solutions that use the following Azure services: Azure Cosmos DB, Azure Synapse Analytics, Azure Data Factory, Azure Stream Analytics, Azure Databricks, Azure Blob storage, Microsoft Purview, etc
What You Have
- Relevant experience in Data Platforms and Azure’s PaaS offerings (Synapse, Purview, ADF, Databricks, Azure Data Lake Storage, etc.)
- Competency in Azure: Synapse Analytics, Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, SQL Database, SQL Managed Instance, Stream Analytics, Cosmos DB, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, ARM Templates
- Proficiency in data processing languages: SQL, Java, Python or Scala
- Strong notions of security best practices (e.g., using Azure Key Vault, IAM, RBAC, Monitor, etc.)
- Ability to integrate, transform and consolidate data from various structured and unstructured data systems into a structure suitable for building analytics solutions
- High-level understanding of Azure DevOps
We Offer
- Salary range 5000-6500 EUR gross, based on your experience and interview results
- Outstanding career development roadmap to accelerate your journey development roadmap to accelerate your journey
- Engineering community of 59,250+ industry’s top professionals
- Certification and mentoring programs, training, and unlimited access to LinkedIn Learning
- Innovative solutions delivery to the world’s industry leaders
- Regular assessments and salary reviews
- Bonuses for participating in the referral program
- Participation in the Employee Stock Purchase Plan
- Flexible schedule and opportunity to work remotely from any place in Lithuania
- Friendly team and enjoyable working environment
- Relocation within offices in 50+ countries with throughout support for you and your family
- Three additional vacation days and four trust days a year (sick leave without a medical certificate)
- Private health insurance and corporate discounts for family members
About EPAM
- We are a team of 59,250+ technologists, strategists, and designers in 50+ countries. EPAMers help leading brands transform their business through our engineering expertise, design thinking, and business consulting. We foster creativity and unconventional ways of doing things welcoming like-minded professionals. Growing fast in Lithuania to 1K EPAMers in less than two years, we have myriads of challenges for you to explore
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Data Engineer with Azure" FinTech Australia.