Data Engineer II

Senior Data Engineer II

TrueML

About TrueML:

TrueML is a mission-driven financial software company dedicated to [briefly state company mission]. We are a passionate team committed to building innovative solutions that empower our clients.

Job Summary:

We are seeking a talented and experienced Senior Data Engineer II to join our growing team. In this role, you will be responsible for designing, building, and maintaining our cutting-edge data LakeHouse platform, ensuring the smooth operation of robust data pipelines, and delivering high-quality data products.

Responsibilities:

• Design, build, and maintain a scalable data LakeHouse platform utilizing open table formats like Apache Iceberg.
• Develop and operate efficient data pipelines for both batch and streaming data, integrating diverse source systems and implementing robust data transformations.
• Analyze business requirements and design, develop, and implement data models and curated data products.
• Manage and optimize a scalable AWS cloud infrastructure for the data platform.
• Monitor data workloads for performance and errors, proactively troubleshooting issues to maintain high data quality.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related technical field (Master's degree preferred).
• 5+ years of hands-on engineering experience, with 3+ years in data-focused roles.
• Strong Python and SQL skills applied to data engineering tasks.
• Proficiency with the AWS data ecosystem, including S3, Glue Catalog, IAM, and Secrets Manager.
• Experience with Terraform and Kubernetes.
• Proven track record of successfully building and operationalizing data pipelines.

Benefits:

• Competitive salary: $62,000 - $77,000 per year, commensurate with experience.
• Unlimited PTO.
• Comprehensive medical benefits package.
• Dynamic and collaborative work environment.

TrueML is an equal opportunity employer and values diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Qualifications

Education:

• Bachelor's degree in Computer Science, Engineering, or a related technical field required. Master's degree preferred.

Experience:

• Minimum 5 years of hands-on engineering experience, including 3+ years in data-focused roles.

Technical Skills:

• Programming: Proficient in Python and SQL for data engineering tasks.
• Cloud Computing: Strong understanding and experience with the AWS data ecosystem, including S3, Glue Catalog, IAM, and Secrets Manager.
• Infrastructure as Code: Experience with Terraform and Kubernetes for managing cloud infrastructure.
• Data Pipelines: Proven track record of successfully building and operationalizing data pipelines for batch and streaming data.
• Data Modeling: Experience designing and implementing robust data models and curated data products.
• Data Lakehouse: Familiarity with open table formats like Apache Iceberg.

Other:

• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work independently and as part of a team.

Key Responsibilities

• Design and Implement Data Infrastructure: Architect, build, and maintain a scalable and reliable data LakeHouse platform utilizing open table formats like Apache Iceberg.
• Develop Data Pipelines: Design, develop, and operate robust data pipelines to ingest, transform, and process diverse data sources, encompassing both batch and streaming data.
• Data Modeling and Product Development: Analyze business requirements and translate them into efficient data models and curated data products, ensuring data quality and accessibility.
• Cloud Infrastructure Management: Manage and optimize a secure and scalable AWS cloud infrastructure for the data platform, leveraging services like S3, Glue Catalog, IAM, and Secrets Manager.
• Performance Monitoring and Troubleshooting: Continuously monitor data workloads for performance bottlenecks and errors, proactively identifying and resolving issues to maintain high data quality and system stability.

TrueML Data Engineer II Hiring Workflow

1. Application Review: AI-powered screening analyzes resumes for required skills and experience.

2. Phone Screening: HR conducts brief phone interviews to assess communication skills and cultural fit.

3. Technical Assessment: Candidates complete a coding challenge and/or technical interview focusing on data engineering concepts and tools.

4. Culture Fit Interview: A conversation with a team member explores candidate's work style, values, and alignment with TrueML's mission.

5. Final Interview: A panel interview with senior engineers and leadership evaluates technical expertise, problem-solving abilities, and leadership potential.

6. Reference Checks: Verifying candidate's experience and work ethic through professional references.

7. Offer & Onboarding: Successful candidates receive a competitive offer package and begin onboarding with TrueML.

About TrueML

TrueML is a mission-driven financial software company dedicated to empowering individuals and businesses through innovative data-driven solutions. We believe in the transformative power of data and strive to build cutting-edge technology that delivers actionable insights and drives positive change.

At TrueML, we foster a collaborative and dynamic work environment where creativity and innovation thrive. We are committed to diversity and inclusion, and we believe that our diverse perspectives are key to our success. We offer competitive compensation and benefits, including unlimited PTO and comprehensive medical coverage, to attract and retain top talent.

Join us as we revolutionize the financial landscape and build a brighter future together.