Senior Data Engineer - Python - AWS - SnowFlake
EPAM Systems
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data Engineer - Python - AWS - SnowFlake" FinTech Australia.Software Engineering, Data Science
Remote
Posted 6+ months ago
Senior Data Engineer - Python - AWS - SnowFlake Description
DESCRIPTION
Join EPAM, as a Senior Data Engineer specializing in Python, AWS, and SnowFlake.
In this role, you'll work within an agile team, develop ETL processes for AWS Glue jobs, design and architect data products, and execute big data projects from end to end.
If you have a strong understanding of the data domain, excellent communication skills, and experience in engineering, we'd love to hear from you.
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
Responsibilities
- Work as a data engineer within an agile team
- Develop ETL processes for AWS Glue jobs
- Develop AWS Lambda functions
- Design and architect data products
- Execute big data projects from end to end
- Communicate effectively in both written and verbal forms
- Develop microservices with hands-on experience
- Write complex queries to address business requirements
Requirements
- Strong understanding of the data domain
- Strong communication skills
- Experience in engineering
Nice to have
- Experience in Spark jobs performance optimization
- Experience with data streaming: AWS Kinesis / Apache Flink / Snowflake
- Experience with IoT
- CI/CD: Atlassian Bitbucket, AWS CodeBuild, Terraform
- Solution implemented in accordance with IaC principles
Technologies
- Apache Spark
- Python (PySpark)
- SQL
- AWS (CLI, S3, Glue, Lambda, Athena, Step Functions, RDS)
- Columnar-based file types
- Microservices (OpenAPI, API Gateway, RDS, etc.)
- Unit tests
We Offer
- Health Insurance
- Life Insurance (SVO)
- Occupational Risk Insurance (ART)
- Paid Time Off – Vacations. 14 calendar days a year, the number of days will increase by seniority based on local law rules
- Sick leave
- Exceptional Leave. Take paid time off for your major life changes (childbirth, marriage, etc.)
- Compensation of costs for internet, electricity, and personal laptop usage (if applicable)
- Stable full-time workload
- Thousands of projects for top brands
- Stable income
- Referral Program
- Certification opportunities
- Unlimited access to LinkedIn learning solutions
- Language courses
- Relocation Assistance Package
Conditions
- By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice and Policy
This job is no longer accepting applications
See open jobs at EPAM Systems.See open jobs similar to "Senior Data Engineer - Python - AWS - SnowFlake" FinTech Australia.