Data Systems Engineer
Pepperstone
The Pepperstone story started in 2010. We know what it’s like to trade the world’s markets. Our team describes us as a place for the curious and the driven, and we like to do things a little differently; as a transformative global fintech we’re digital, nimble, connected, and united in our vision to create a better way to trade.
We thrive on progress – for our clients and for ourselves. Our organisational culture is ever-evolving, vibrant, diverse, global and results focused. You’ll find our 550+ team currently across 11 locations and 9 time zones.
The Role
Our technology team thrives on inclusivity and collaboration, believing that diverse perspectives lead to great solutions. We foster a culture that champions individual growth, professional development, and work-life harmony. We're invested in your success and dedicated to supporting you every step of the way. We encourage our team to bring challenge thinking and fresh ideas to the table and our Agile approach empowers us to focus on outcomes. When we hire someone it's because they bring the skills, attitude and experience we're looking for....so we let you do what you're best at! Join us and be part of a community that's passionate about harnessing technology's potential to drive market leading solutions for our clients. Elevate your career in an environment where your ideas matter, your growth is nurtured, and your potential is limitless.
As a Data Systems Engineer, you will play a crucial role in building and maintaining data infrastructure and pipelines that are reliable, scalable, and aligned with business needs. You will work on both real-time and batch processing systems, ensuring data integrity and availability across the organisation. This role requires collaboration with cross-functional teams to implement innovative solutions that address the demands of our rapidly evolving technology landscape.
You will work closely with Pepperstone’s Data Platform and Data System Engineering teams, which are responsible for the collection, transfer, transformation, and storage of customer and trading data to support a variety of internal and external purposes.
As our Data Systems Engineer, your key responsibilities include, but may not be limited to:
- Maintain and Enhance Data Infrastructure: Continuously improve and maintain data infrastructure, ensuring optimal performance and reliability.
- Develop Data Pipelines: Design, implement, and optimise data pipelines for batch and real-time data processing using Python, Go, and other relevant tools.
- Data Systems Management: Manage and monitor data systems including Kafka, Redshift, and Kubernetes, ensuring they meet performance and reliability standards.
- Collaboration & Integration: Work closely with stakeholders and team members to integrate new data sources and support existing ones, ensuring seamless data flow across systems.
- Workflow Automation: Develop and manage automated workflows using Airflow and DBT to support data processing and transformation tasks.
- Cloud Infrastructure: Leverage AWS services to build and maintain cloud-based data infrastructure, ensuring scalability and security.
- Monitoring & Troubleshooting: Implement monitoring solutions and troubleshoot issues to maintain high availability and performance of data systems.
- Documentation & Best Practices: Document systems, processes, and best practices, ensuring that knowledge is shared, and systems are well-maintained.
- Collaboration on Development Practices: Work with the team to improve software development practices, including coding standards, test-driven development, and CI/CD processes.
- Weekly Support Rotation: Participate in the weekly support rotation, providing first-level support for any incidents impacting the data engineering space.
About You
- 3-5 years of experience in data engineering or a related field, with a strong understanding of data processing and distributed systems.
- Proficiency in Python and/or Go, with experience in building data-intensive applications
- Experience with data streaming and batch processing technologies, particularly Kafka, Redshift, and related tools.
- Solid experience with AWS services (e.g. S3, Redshift, RDS) and infrastructure-as-code tools (e.g. Terraform)
- Hands-on experience with Airflow, DBT, or other workflow automation tools
- Knowledge of various data formats (e.g. Parque, Avro) and table formats (e.g. Iceberg, Hudi)
- Understanding of DBMS concepts and experience with both SQL and NoSQL databases
- Awareness of data security best practices and compliance requirements such as GDPR
- Strong problem-solving skills, with the ability to troubleshoot complex data issues and propose innovative solutions.
- Adaptability to work in a fast-paced, evolving environment with shifting priorities.
- A proactive approach to identifying improvements and addressing challenges.
- Strong attention to detail to ensure data systems are accurate and reliable.
- Excellent communication skills, both verbal and written, and the ability to collaborate effectively in a team-oriented environment.
- Ability to live the Pepperstone values
- Committed to ongoing learning and development
Why you will enjoy working with us
- Competitive salary structure including company bonus scheme
- Genuinely collaborative and friendly culture
- Flexible and hybrid working
- Remote working option - work from anywhere for up to 6 weeks per year, in addition to hybrid working as standard
- Ongoing personal development & learning opportunities
- 15 weeks paid primary carers parental leave & 4 weeks paid secondary carers leave
- 3 paid volunteering days per year & Workplace Giving Program
- Frequent events and celebrations including a standard weekly social
- Beautifully renovated large office at Collins Square - 727 Collins Street, Melbourne
- Best in class end of trip facilities including bicycle parking, change rooms & showers
- A full stocked kitchen, onsite coffee machines with locally sourced coffee beans (this is Melbourne after all) and curated specialty teas
About Pepperstone
We’re a regulated online Forex and CFD trading platform. With the scale of a global fintech and the agility of a start-up, we arm our clients with everything they need to take on the global markets with confidence. You will be part of a wider passionate and friendly team, and whilst things may not always go to plan, we learn quickly and move forward with impact. To learn even more visit Pepperstonecareers and www.linkedin.com/company/pepperstone/
We understand it’s important to do due diligence on a prospective employer, see what our team are saying on Glassdoor. We respect our team members’ experiences and will never pay to remove a negative review.
Pepperstone is an equal opportunity employer. We are passionate about building a diverse workplace and strongly encourage applications from any background.
“We are a 2025 Circle Back Initiative Employer – we respond to every applicant”.
We will be reviewing applications as they come through, so if this is an opportunity that excites you, don't wait. Express your interest by clicking the apply button below as soon as possible.
Note to external agencies: While we appreciate the efforts of external recruitment agencies, we prefer to engage directly with applicants for this opportunity.
#Li-Hybrid