Machine Learning Engineering & 6 others
EPAM Systems
Software Engineering, Data Science
Ukraine
Posted on Jan 16, 2026
Responsibilities
- Build agentic systems tailored to various Software Development Lifecycle (SDLC) personas, translating requirements into actionable implementations
- Partner closely with cross-functional teams to understand workflows and ensure alignment with stakeholder needs
- Design and implement robust evaluation test cases for LLMs using LLMs as judges and deterministic methodologies
- Evaluate model performance and ensure reliability using tools such as LangSmith, LangFuse, or MLFlow
- Develop and fine-tune prompt frameworks to align LLMs with diverse agent requirements
- Utilize programming expertise in Python and AI/ML frameworks to enhance agentic systems' capabilities
- Monitor, debug, and optimize AI systems’ performance using advanced testing and automation practices
- Leverage modern SDKs like LangGraph or similar frameworks to efficiently build intelligent workflows
- Foster continuous improvement by incorporating feedback, testing outcomes, and insights into future iterations
- Act as a thought leader on AI testing standards, governance, and best practices in agentic system development
Requirements
- 3+ years of experience in AI engineering, with emphasis on LLMs and agentic systems
- Knowledge of modern testing standards and practices applied to agentic systems
- Strong programming and development skills in Python, with usage of AI/ML frameworks and libraries
- Familiarity with evaluation and monitoring tools such as LangSmith, LangFuse, or MLFlow
- Competency in using SDKs like LangGraph or similar frameworks for agentic system development
- Understanding of LLM concepts, including prompt engineering and fine-tuning methodologies
- Knowledge of testing frameworks and automation tools for validating AI systems
- Analytical and problem-solving skills, with a focus on delivering reliable and effective solutions
- Proficiency in communication and collaboration, ensuring successful teamwork across roles
- Capability to work independently, delivering high-quality AI solutions in a dynamic environment
- Excellent written and spoken English (B2+ level)
Nice to have
- Experience writing agentic systems using SDKs like LangGraph or similar technologies
- Familiarity with evaluation tools such as LangSmith, LangFuse, or MLFlow
- Understanding of AI governance, safety, and ethical considerations in agentic systems
- Showcase of enterprise-grade AI solutions with multiple integrations and workflows
We offer/Benefits
With us you can:
- Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
- Receive the necessary equipment to perform your work tasks
- Change projects and technology stacks within EPAM
- Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
- Relocation opportunities may be available for eligible candidates, depending on the role and openings at other EPAM locations
- Participate in volunteer, charity programs and communities (both technical and interest-based)
We focus on your professional growth:
- You can plan your individual career path together with your manager
- Receive regular feedback from colleagues
- Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
- Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
- Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
- Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
- Study at EPAM Solution Architecture School with the instructors who are practicing architects
- Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
- Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
What we offer:
- Vacation and sick leave (including a sick leave without a medical certificate)
- A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
- Medical insurance for family members at corporate rates
- Company support during significant life events (childbirth or adoption, marriage, etc.)
- Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
- E-kids program - a free programming language training program for EPAMers' children