Develop and maintain systems to meet service level agreements while delivering innovative, cost-effective, and high-quality solutions with rapid time to market

Manage code versioning and oversee code deployments for data pipelines

Ensure comprehensive unit test coverage and support integration and performance testing

Contribute ideas to establish and uphold required standards and processes

Research and assess current and emerging technologies and frameworks

Build deep expertise in data and take ownership of data quality within your domain

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field

Minimum 3 years of relevant experience in data engineering

Proficiency in Scala development

Experience working with both SQL and NoSQL databases, handling structured and unstructured data

Strong background with the Spark processing engine

Knowledge and experience in data modeling

Ability to analyze data to identify opportunities and address gaps

Experience working with cloud or on-premises big data platforms such as Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar

Fluent English skills, both written and spoken, at a B2+ level or higher

Programming experience in Python

Familiarity with big data tools, technologies, or streaming platforms such as Hive, Impala, OOZIE, Airflow, NIFI, or Kafka

Experience with Java

Knowledge of Terraform