Role Description We are seeking a Senior Data Engineer to play a pivotal role in shaping the future of data at Smart Communications. As we continue our transformation toward a modern, data-driven organisation, you will help design, build, and scale the enterprise data platform that underpins analytics, reporting, automation, and AI initiatives across the business. Reporting to the Manager of Data Operations, you will take ownership of delivering robust, scalable data solutions within Databricks, helping establish a single source of truth and enabling trusted, self-service access to data across the organisation. Working closely with stakeholders across Finance, Product, Sales, Marketing, Customer Success, and Engineering, you will translate business challenges into technical solutions that drive measurable outcomes. This is a highly visible, hands-on role with the opportunity to influence data architecture, platform strategy, and engineering standards while helping mature a growing data capability. You will work alongside a Junior Data Engineer as part of a small, high-impact team responsible for bringing the company's data strategy to life and unlocking the full value of its data assets. Responsibilities - Design, build, and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL, and Delta Lake. - Develop and optimise ETL/ELT processes to ingest, transform, and curate data from internal and external systems. - Design and evolve enterprise data architecture, ensuring scalability, performance, security, and maintainability. - Partner with business stakeholders to understand requirements, translate business challenges into technical solutions, and identify opportunities to leverage data more effectively. - Ensure data quality, governance, security, and access controls are embedded throughout the data lifecycle. - Monitor, troubleshoot, and optimise data platform performance, reliability, and cost efficiency. - Enable analytics, reporting, AI, and self-service BI initiatives through trusted and accessible datasets. - Maintain engineering standards, CI/CD processes, technical documentation, and operational procedures. - Mentor junior team members and contribute to continuous improvement across the data function. Qualifications - 8+ years of experience in Data Engineering or a related field. - Strong hands-on experience with Databricks, including PySpark, Spark SQL, Delta Lake, Unity Catalog, and Lakehouse architecture. - Advanced SQL and Python development skills. - Proven experience building and optimising enterprise-scale data pipelines and ETL/ELT solutions. - Strong understanding of data architecture, data modelling, data warehousing, and modern data platform design. - Experience working with cloud platforms, preferably AWS. - Experience implementing data governance, security controls, and role-based access models. - Experience with source control, CI/CD, and software engineering best practices. - Excellent problem-solving, communication, and stakeholder management skills. Advantageous Skills/Experience - Experience with Databricks AI/BI, Genie, Genie Spaces, and Databricks Apps. - Experience designing enterprise data solutions and architecture roadmaps. - Experience supporting BI, analytics, or self-service reporting capabilities. - Experience within SaaS or subscription-based businesses. - Experience with SQL Server and SSIS. - Exposure to AI, machine learning, or advanced analytics solutions. - Experience mentoring or leading other engineers. SMART Values - S peak Openly - We are positive, creative, helpful, kind and we have fun. We listen and provide constructive feedback. Through meaningful conversations we encourage each other to be the best that we can be. We're not complainers we're problem solvers. - M ake a Difference - We focus on the things that matter and prioritize the things that have the greatest impact. We celebrate success and hold ourselves accountable for our choices. We don't sit on the sidelines. - A gile & Flexible - We are focused on evolving, improving and growing. We think differently and challenge the status quo with open minds. We ask 'why?' so that we can help remove complexity. We don't allow hurdles to get in our way. - R esults-Focused - We get stuff done by being efficient, working at pace and paying attention to detail. We focus on finding solutions and fixing things. We don't believe in being busy for the sake of being busy, we focus on productivity. - T eamwork - We are stronger and better together. We collaborate, trust and support each other to deliver results for our company and our customers. We don't want anyone to feel disengaged, we're in this together! Benefits - Tools, equipment, and support to achieve your goals. - Highly competitive salary based on experience. - Friendly and fun working environment. - Extensive health insurance. - Income protection and life assurance. - Subsidised gym membership. - Leisure travel insurance. - Pension contribution. - 25 days' holiday allowance plus an additional day off for your birthday! - Comfortable, flexible office located in Covent Garden, stocked with free beverages and fresh fruit. - Remote role with occasional visits to the office as required.