Senior Python Data Engineer
EPAM Systems
Senior Python Data Engineer Description
We are actively seeking a seasoned Senior Python Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Python programming, as well as a basic understanding of Machine Learning (ML) and Artificial Intelligence (AI) concepts. The chosen candidate will primarily focus on porting, designing, building, and optimizing data pipelines that fuel our AI applications, enabling efficient data handling, analysis, and modeling.
#LI-DNI
Responsibilities
- Develop, maintain, and optimize data pipelines that serve as the foundation for our AI applications
- Collaborate with software engineers, and AI experts to design and implement scalable, efficient, and reliable data architectures
- Build and enhance data ingestion, extraction, transformation, and loading (ETL) processes to ensure data quality and integrity
- Implement data validation and testing techniques to guarantee the accuracy and consistency of information across the pipelines
- Collaborate with cross-functional teams to understand AI application requirements and implement suitable ML and AI solutions
- Optimize the performance of existing data infrastructure, pipelines, and ETL processes to improve efficiency and scalability
- Document all data-related processes, including pipeline configurations, transformations, and data flow
Requirements
- Proven experience in a similar role, specifically working with data pipelines for AI applications
- Proficiency in Python programming and experience with relevant libraries such as Pandas, NumPy, and PySpark
- Basic understanding of ML and AI concepts, including entity extraction (NLP methods)
- Experience with designing and implementing scalable data architectures for AI applications
- Strong expertise in data modeling, ETL processes, and database management systems (e.g., PostgreSQL)
- Familiarity with AWS or Azure cloud platforms and services for building and deploying data solutions for AI
- Strong problem-solving and troubleshooting skills, able to address issues promptly and efficiently
- Excellent communication and collaboration skills to work effectively within cross-functional teams
- A self-motivated and proactive attitude, capable of prioritizing tasks and working independently
- B2+ English level proficiency
Nice to have
- Azure cloud knowledge is a plus
- Understanding of Knowledge Graph technology
We offer
- CONTINUOUS UPSKILLING, LEARNING & DEVELOPMENT:
- Diversity of tasks and projects
- Assessment center for objective review of competency level
- Personal development plan
- Mentoring programs and leadership development
- Certification and professional development support
- Access to learning platforms including more than 2,500 internal courses and the LinkedIn Learning library with 20,000+ courses
- English courses taught by certified teachers
- CORPORATE BENEFITS:
- Extra leave days
- Referral bonuses
- COMPENSATION PACKAGE:
- Competitive compensation paid in USD
- Regular salary and performance reviews
- MEDICAL & HEALTHCARE:
- Private health insurance
- Well-being events
- WORKING ENVIRONMENT:
- Recreation areas and kitchens
- Tea, coffee, and snacks
- Well-being events
- Sports equipment and game consoles
- IT Equipment
- Microsoft's Software Assurance Home Use Program (HUP)
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.