Lead Big Data Engineer
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Big Data Engineer" FinTech Australia.Data Science
Remote
Posted 6+ months ago
Lead Big Data Engineer Description
We are seeking a highly skilled Lead Big Data Engineer to lead the design and implementation of innovative analytical solutions using cutting-edge Big Data technologies.
As a key team member, you will assess new features and architectures across Cloud, on-premise, and Hybrid solutions and closely cooperate with product and engineering teams.
The remote option applies only to the Candidates who will be working from any location in Kyrgyzstan.
As a key team member, you will assess new features and architectures across Cloud, on-premise, and Hybrid solutions and closely cooperate with product and engineering teams.
The remote option applies only to the Candidates who will be working from any location in Kyrgyzstan.
What You’ll Do
- Lead and implement innovative analytical solutions using Big Data related technologies, evaluating new features and architecture in Cloud, on premise & Hybrid solutions
- Collaborate with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
- Establish collaborative partnerships with architects and key individuals across various functional groups
- Perform detailed analysis of business problems and technical environments to design quality technical solutions
- Actively participate in code reviews and test solutions for best practice compliance
- Cultivate a high-performance engineering culture, mentor team, and provide necessary tools and motivation
- Write project documentation
What You Have
- Advanced experience in software development with Big Data (administration, configuration management, monitoring and performance tuning)
- Skills in designing, automating and managing scalable, fault-tolerant cloud systems
- Advanced knowledge of Cloud-based data pipeline development
- Experience With Cloud Service Lines:
- AWS: AWS Glue, EMR, S3, Redshift, Kinesis, Databricks, AWS Lake Formation
- Azure: Data Lake, Databricks, Synapse, Data Factory
- GCP: DataFlow, GCS, BigQuery, Dataproc, Cloud Composer
- Competency in any object-oriented/object function scripting language: Python, Java, Node.js
- Background in Big Data Stacks such as Spark & Spark Streaming
- Strong knowledge of building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture
- Expert knowledge of data modeling and modern Big Data component development
- Understanding of CI/CD principles and best practices
- Exposure working with Snowflake
- Proficiency in direct customer communications
- Expertise in technology/team leading of data-oriented projects
- In-depth comprehension of distributed computing principles
We Offer
- We connect like-minded people::
- Delivering innovative solutions to industry leaders, making a global impact
- Enjoyable working environment, whether it is the vibrant office or the comfort of your home
- Opportunity to work abroad for up to two months per year
- Relocation opportunities within our offices in 50+ countries
- Corporate and social events
- We invest in your growth::
- Leadership development, career advising, soft skills and well-being programs
- Certifications, including GCP, Azure and AWS
- Unlimited access to LinkedIn Learning, Get Abstract, O'Reilly, Cloud Guru
- Free English classes with certified teachers
- We cover it all::
- Monetary bonuses for engaging in the referral program
- Comprehensive medical & family care package
- Six trust days per year (sick leave without a medical certificate)
- Coverage of psychology sessions of your choice
- Discounts for fitness clubs and sports programs
- Benefits package (hotels, bookstores, food delivery)
About EPAM
- EPAM Kyrgyzstan is a team of technologists and innovators united by a passion for technology. In 2022, we opened our first office in Bishkek that works with the world's leading companies across many different industries. EPAM builds a continuously learning organization and helps its employees reach their full potential and achieve their professional goals through learning. Our agile methodologies, client collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Big Data Engineer" FinTech Australia.