Apply Apply

DESCRIPTION

We are looking for an open-minded Senior / Lead Data Engineer to develop and maintain data-driven architecture. On our projects, we are developing pipelines to build business-related data products and design cloud-based platform solutions to support DataHub functionality.

What You’ll Do

• Design and implement data pipelines
• Perform data ingestion processes to include existing data sources in the new platform
• Participate in platform engineering, including cloud-based solutions to support solution architecture, such as Ingestion Frameworks, Platform Orchestrators, Exploratory environments etc
• Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines
• Take part in the design of on-prem to cloud migration activities

What You Have

• Solid experience in Java, Python or Scala
• Proficiency in SQL
• Understanding of common Big Data problems (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and related technologies (Apache Spark, Map-Reduce, HDFS)
• Acquaintance with data modeling: relational/dimensional data, SCD, snowflaking, etc
• English level – B1+, both written and spoken

Nice to have

• Familiarity with common data-related architectures such as Data-Hub/Data Lake
• Experience in cloud-based solutions, GCP, Terraform, Kubernetes

Technologies

• Apache Spark, Kubernetes, Hadoop, Cloud Storage (S3, ADLS, GS, etc.), Cloud Functions, Airflow, Apache Kafka, Jenkins, Terraform, Avro, Parquet

We Offer

• Outstanding career development opportunities with a transparent roadmap to accelerate your journey
• Knowledge sharing within the community of the industry’s top professionals worldwide
• Various opportunities for self-development: hard & soft skills internal training courses, mentoring programs, and unlimited access to 8,000+ LinkedIn Learning courses
• Free English classes with certified teachers
• Competitive compensation, regular assessments, and salary reviews
• Participation in the Employee Stock Purchase Plan
• Flexible working schedule
• Friendly team, and enjoyable working environment
• Relocation opportunities within our offices in 50+ countries
• Social package – medical & family care
• Five trust days a year (sick leave without a medical certificate)

About EPAM

• EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, customers, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow