Principal Data Engineer

Principal Data Engineer - Smoove (Part of PEXA Group)

About Smoove

Smoove, a leading provider of technology solutions in the property sector since 2003, is part of the PEXA Group, a global leader in digital property transactions. We are passionate about leveraging technology to simplify and streamline the property journey.

About the Role

We are seeking a highly experienced Principal Data Engineer to join our growing team. You will play a pivotal role in designing, developing, and maintaining our data infrastructure, ensuring the delivery of high-quality, reliable data to power our analytics and business intelligence initiatives.

Key Responsibilities

• Design and oversee scalable, performant, and secure data architectures on Databricks and distributed systems.
• Lead the design and development of robust, high-performance data pipelines using PySpark and Databricks.
• Ensure end-to-end data quality from raw ingestion to curated, trusted datasets.
• Establish and enforce best practices for data governance, lineage, metadata, and security controls.
• Act as a technical authority and mentor, guiding data engineers.

Required Skills

• Extensive experience as a Data Engineer, including technical leadership.
• Broad cloud experience, ideally with both Azure and AWS.
• Deep expertise in PySpark and distributed data processing at scale.
• Advanced SQL optimization and schema design for analytical workloads.
• Strong understanding of data security, privacy, and GDPR/PII compliance.

Compensation

• £70,000 - £90,000 per year.

We offer a competitive salary and benefits package, along with the opportunity to work on challenging and impactful projects in a dynamic and collaborative environment.

Qualifications

Essential:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5+ years of proven experience as a Data Engineer, with at least 2 years in a technical leadership role.
• Demonstrated expertise in designing and implementing scalable data architectures on cloud platforms (Azure and/or AWS).
• Strong proficiency in PySpark, Databricks, and distributed data processing frameworks.
• Advanced SQL skills, including optimization and schema design for analytical workloads.
• Solid understanding of data security, privacy principles, and compliance with regulations like GDPR and PII handling.

Desirable:

• Experience with data governance frameworks and tools.
• Familiarity with data visualization and business intelligence tools.
• Experience in the property or financial services industry.
• Relevant industry certifications (e.g., AWS Certified Data Analytics - Specialty).

Technical Design & Development

• Architect and implement scalable, high-performance data solutions on Databricks and distributed systems.
• Design and develop robust data pipelines using PySpark, ensuring efficient data ingestion, transformation, and loading.
• Optimize SQL queries and schema designs for analytical workloads, maximizing query performance and data integrity.

Data Quality & Governance

• Establish and maintain data quality standards, ensuring the accuracy, completeness, and consistency of data throughout the lifecycle.
• Implement robust data governance policies and procedures, including data lineage tracking, metadata management, and access controls.
• Adhere to data security best practices and regulatory compliance requirements, such as GDPR and PII handling.

Team Leadership & Mentorship

• Provide technical guidance and mentorship to junior data engineers, fostering a collaborative and knowledge-sharing environment.
• Stay abreast of emerging technologies and industry trends in data engineering, proactively incorporating best practices into solutions.
• Contribute to the continuous improvement of data engineering processes and tools, driving efficiency and innovation within the team.

Candidates interested in the Principal Data Engineer position at Smoove, part of the PEXA Group, will first submit their resume and cover letter through the job portal. A review of applications will be conducted, focusing on relevant experience and skills outlined in the job description. Shortlisted candidates will be invited for a phone screening to discuss their qualifications and experience in more detail.

Successful candidates from the phone screening will then participate in a technical interview, assessing their expertise in areas like PySpark, Databricks, and data pipeline design. A final stage will involve a panel interview with senior members of the Smoove team, focusing on leadership, communication, and cultural fit.

The entire process aims to identify the most qualified and suitable candidate for the Principal Data Engineer role, ensuring a strong match with Smoove's values and the demands of the position.

Smoove, a leading technology provider in the property sector, has been transforming the industry since its founding in 2003. As part of the PEXA Group, a global leader in digital property transactions, Smoove leverages cutting-edge technology to streamline and simplify property processes. With a commitment to innovation and customer-centricity, Smoove empowers property professionals and individuals with efficient, secure, and transparent solutions. The company's dedication to excellence has earned it a reputation as a trusted partner in the ever-evolving world of real estate.