Set up required Azure services

Extract data from the data lake (EDL)

Process data based on application requirements and architecture

Build the service layer and mimic the current existing application

Collaborate with Developers, Product and Program Management, and senior technical staff to deliver customer-centric solutions.

Provide technical input for new feature requirements, partnering with business owners and architects

Ensure continuous improvement by staying abreast of industry trends and emerging technologies

Drive the implementation of solutions aligned with business objectives.

Mentor and guide less experienced team members, helping them enhance their skills and grow their careers

Participate in code reviews, ensuring code quality and adherence to standards

Collaborate with cross-functional teams to achieve project goals

Actively contribute to architectural and technical discussions

At least 3 years of experience as a Data Software Engineer or in similar roles

Deep expertise in Databricks for building scalable data pipelines

Expertise in Python and PySpark for data processing and analysis

Experience with Microsoft Azure and SQL Azure for cloud-based infrastructure and application management

Proficiency in Advanced SQL for data querying and manipulation

Experience in Python web services such as Django and Flask

Experience with Agile development methodologies and DevOps practices

Familiarity with Git for version control and collaboration

Excellent communication skills in spoken and written English, at an upper-intermediate level or higher

Experience with Azure Data Factory, Azure Synapse Analytics, and Azure Stream Analytics is a plus