Senior Software Engineer - Data Engineering

Company Overview

Job Overview

Come join the Data Engineering Team as a Senior Software Engineer. We are leveraging big data technologies to gain new insights into our customer experiences, building data frameworks, ingestion pipelines and tools. Some of the technologies we are leveraging include Google Cloud, Hive and AWS Big Data Systems.

Participate in the entire product lifecycle for data, software products and services that are broad in scope and complexity, applying a full understanding of software engineering methodologies and industry best practices for data product. Work with Industry Experts; Senior, Staff and Principal Engineers, utilize specialized knowledge to develop, and maintain Intuit’s data solutions.

Responsibilities

• 70-85% hands-on development in all phases of the software life cycle.• Rapidly fix bugs and solve problems • Conduct design, code reviews and defect remediation• Create technical design specification and implement data models for analytics, reporting, and machine learning workflows• Lead, estimate work for initiatives and sequence of individual activities as inputs to project plans • Clean, transform and validate data for use in analytics and reporting• Optimize data processing for performance, cost and reliability while monitor data quality and pipeline performance, troubleshoot and resolve data issues• Collaborates effectively with peer engineers, data scientist, analyst and architects to solve complex problems spanning their respective areas to deliver end-to-end quality in our technology and customer experience. • Influences and communicates effectively with non-technical audiences including senior product and business management.• Designing/developing ETL jobs across multiple big data platforms and tools including S3, EMR, Hive, Spark SQL, PYSpark• Experience with Agile Development, SCRUM, and/or Extreme Programming methodologies• Actively stay abreast of industry best practices, share learnings, and experiment and apply cutting edge technologies while proactively identifying opportunities to enhance software applications with AI technology.

Intuit provides a competitive compensation package with a strong pay for performance rewards approach. The expected base pay range for this position in Bay Area California is $165,500 - $223,500 and in Southern California is $150,000 -$203,000. This position will be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs (see more about our compensation and benefits at Intuit®: Careers | Benefits). Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. To drive ongoing pay equity for employees, Intuit conducts regular comparisons across categories of ethnicity and gender.

Qualifications

• BS or MS in Computer Science, Data Engineering or related field or equivalent experience• 6+ years of core development experience with data engineering experience• Proficiency in developing Software for Java (Spring & Springboot), Scala for spark streaming & spark applications, or other JVM based languages.• Expert Knowledge of SQL, XML, JSON, YML, very strong Python and Linux • Proficiency with tools and frameworks Docker, Spark, Scala, Jupiter Notebook, Databricks Notebooks, Kubernetes, Feature Management Platforms, SageMaker• Expert knowledge of software development methodologies and practices • Strong background using cloud platforms such as AWS, Azure or GCP - Amazon web services: EC2, S3, and EMR (Elastic Map Reduce) or equivalent cloud computing approaches• Strong expertise in Data Warehousing and analytic architecture and working with large data volumes, data visualization• Experience with low-latency NoSQL datastores (such as DynamoDB, HBase, Cassandra, MongoDB) is a plus• Experience with building stream-processing applications using Spark Streaming, Flink, etc. is a plus