Lead Kafka Engineer (GCP, AWS)
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Kafka Engineer (GCP, AWS)" FinTech Australia.Ukraine
Posted 6+ months ago
Lead Kafka Engineer (GCP, AWS) Description
We are looking for a Lead Kafka Engineer (GCP, AWS) to make the team even stronger.
Our client is a leading provider of property insights and innovative solutions, their work is directly involved with the largest asset class in the world — property.
We are building Kafka platform support team. The candidate will be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, developing new features/automation/integration. Kafka Platform team is also involved in supporting PagerDuty and Uptrends SaaS including automation of these platforms support.
This role requires participation in an on-call support rota, including up to 8 hours on one weekend day (Saturday or Sunday).
The remote option applies only to the Candidates who will be working from any location in Ukraine.
#LI-IK2
Our client is a leading provider of property insights and innovative solutions, their work is directly involved with the largest asset class in the world — property.
We are building Kafka platform support team. The candidate will be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, developing new features/automation/integration. Kafka Platform team is also involved in supporting PagerDuty and Uptrends SaaS including automation of these platforms support.
This role requires participation in an on-call support rota, including up to 8 hours on one weekend day (Saturday or Sunday).
The remote option applies only to the Candidates who will be working from any location in Ukraine.
#LI-IK2
Responsibilities
- Install and provision new Kafka clusters and supporting components
- Regularly monitor the health and performance of the Kafka platform and data pipelines
- Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resources failures, or software bugs
- Perform regular performance tuning of Kafka platform components
- Monitor and optimize the cost and performance of Kafka clusters
- Upgrade the Kafka platform to newer versions, including planning, testing, and implementation
- Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews
- Perform regular backups and disaster recovery procedures
- Manage the capacity of the Kafka platform, including projecting future growth and scaling needs
- Document procedures, configurations, and issue resolutions, and share knowledge with the team
- Work with Confluent Support for issues that cannot be resolved in-house
- Support existing Infrastructure as Code (IaC) and Configuration Management (CM) automations/pipelines for Kafka platform management and maintenance
- Maintain and enhance onboarding automation scripts
- Support Kafka self-service automations for Topic, RBAC, Schema, Connectors management
- Support application teams in setting up and onboarding Kafka consumers, producers, connectors, and streams
- Provide support for team requests in Slack and convert to CLOUD Tickets if complexity is high
- Implement new features released by the vendor as part of their product roadmap, in coordination with the CoreLogic Platform owner team
- Implement and enhance automation scripts and processes to reduce the number of tickets via self-service
Requirements
- 5+ years of strong proficiency in Devops
- 1+ year of leading experience
- 3+ years of experience with Cloud GCP+AWS (compute, networking, storage, IAM)
- Proven experience in the implementation and maintenance of Confluent Platform
- Strong knowledge of HELM
- Python/Shell scripting and automation experience, HELM Kubernetes/Containers, Docker
- Excellent problem-solving skills and the ability to troubleshoot complex issues
- Experience in automating processes and maintaining automated scripts
- Understanding of networking, and capability to coordinate with different teams including the Networking team, and CICD team, among others
- Upper-intermediate or higher English level, both spoken and written (B2+)
Nice to have
- PagerDuty
- Uptrends
- Terraform
We Offer
- Competitive compensation depending on experience and skills
- The individual career path
- Social package - medical insurance, sports
- Compensation for sick lists and regular vacations
- English classes with certified English teachers
- Unlimited access to LinkedIn learning solutions
- Flexible work hours
About EPAM
- EPAM is a leading global provider of digital platform engineering and development services. We are committed to positively impacting our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to learn and grow continuously. You will join a dedicated, creative, and diverse community that will help you discover your fullest potential. EPAM is committed to providing our global team of 52,800+ EPAMers with inspiring careers. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success, and we value collaboration, try always to understand our customers' business, and strive for the highest standards of excellence
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Lead Kafka Engineer (GCP, AWS)" FinTech Australia.