Smart Working logo
Smart Working

Empowering companies to work with the best engineers in the world

Senior Software Engineer, Data Focused

Data EngineerData EngineerFull TimeRemoteSeniorTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

India

Posted

3 days ago

Salary

0

Seniority

Senior

Job Description

Senior Software Engineer, Data Focused

Smart Working

• Support and maintain data ingestion pipelines, including connectors that pull data from NHS systems, practice management systems, and laboratory or equipment sources using APIs and screen-scraping. • Own and support the BigQuery ingestion layer and the downstream SQL Server and SQL Azure processing responsible for calculating dentist pay. • Proactively identify, investigate and resolve data ingestion issues while improving platform observability and monitoring. • Handle enterprise customer support requests and tactical enhancement requests for the existing platform. • Work across a highly distributed, brownfield, heavily customised environment supporting multiple bespoke customer deployments. • Review and occasionally adjust SQL-driven commands used by the legacy on-premises Delphi connector where required. • Contribute to tactical process improvements, including introducing source control through GitHub Enterprise and improving CI/CD practices using Azure DevOps. • Perform light-touch maintenance of the existing .NET web application. • Trace and resolve complex issues across stored procedures, Common Table Expressions (CTEs), SQL Server business logic and distributed systems. • Solve ambiguous production problems independently while collaborating within a Kanban team. • Help improve SDLC controls and engineering processes in an environment where production changes currently occur without CI/CD safeguards. • Deliver careful production changes while responding quickly to live customer issues.

Job Requirements

  • 5+ years’ experience in data engineering, including data pipelines and ingestion, ideally using GCP BigQuery, Airflow and Cloud Composer; equivalent large-scale data pipeline experience on another cloud platform may also be considered.
  • 5+ years’ experience with SQL Server and T-SQL, including stored procedures, Common Table Expressions (CTEs), and business logic implemented within the database.
  • 2+ years’ experience with GCP tooling, specifically BigQuery, Airflow and Cloud Composer; Azure Data Factory or a similar data integration platform may be considered as an alternative.
  • 2+ years’ experience with Azure, including SQL Azure, Azure Functions and Azure DevOps; equivalent AWS or GCP hosting experience may also be considered.

Benefits

  • Fixed Shifts: 12:00 PM - 9:30 PM IST (Summer) | 1:00 PM - 10:30 PM IST (Winter)
  • No Weekend Work: Real work-life balance, not just words
  • Day 1 Benefits: Laptop and full medical insurance provided
  • Support That Matters: Mentorship, community, and forums where ideas are shared
  • True Belonging: A long-term career where your contributions are valued

Related Categories

Related Job Pages

More Data Engineer Jobs

Sport Alliance GmbH logo

AI-First Data Engineer

Sport Alliance GmbH

Digitalization of the fitness industry - Leading service provider for SaaS, Fintech, and lead generation.

Data Engineer3 days ago
Full TimeRemoteTeam 201-500Since 2011H1B No Sponsor

• Build and optimize cloud-native data pipelines on AWS — ETL/ELT and the infrastructure underneath (Aurora, Redshift, dbt, Spark/EMR, Airflow, CDC) — using AI tooling as a standard part of the workflow. • Design and evolve the data models that power analytics, operational use cases, and AI/ML across thousands of studios. • Help raise the bar on data reliability — embed governance, testing, and lineage so both people and AI systems can trust the numbers by default. • Partner with product, and other engineering teams to turn ambiguous business problems into robust data solutions. • Evaluate and evolve new approaches with us — data mesh patterns, and emerging AI tooling — and help decide what genuinely earns a place in our stack. • Grow into our financial and regulatory reporting workstream (Finion Capital), where correctness and auditability matter most.

Poland
zł24K - zł28K / month
Sport Alliance GmbH logo

AI-First Data Engineer

Sport Alliance GmbH

Digitalization of the fitness industry - Leading service provider for SaaS, Fintech, and lead generation.

Data Engineer3 days ago
Full TimeRemoteTeam 201-500Since 2011H1B No Sponsor

• Build and optimize cloud-native data pipelines on AWS — ETL/ELT and the infrastructure underneath (Aurora, Redshift, dbt, Spark/EMR, Airflow, CDC) — using AI tooling as a standard part of the workflow. • Design and evolve the data models that power analytics, operational use cases, and AI/ML across thousands of studios. • Help raise the bar on data reliability — embed governance, testing, and lineage so both people and AI systems can trust the numbers by default. • Partner with product, and other engineering teams to turn ambiguous business problems into robust data solutions. • Evaluate and evolve new approaches with us — data mesh patterns, and emerging AI tooling — and help decide what genuinely earns a place in our stack. • Grow into our financial and regulatory reporting workstream (Finion Capital), where correctness and auditability matter most.

Germany
€72K - €82K / year

Role Description We're partnering with a growing organisation looking to expand its data team with the addition of a Senior Data Engineer. This is an opportunity to work on a range of data projects, helping to build and optimise modern data solutions that support reporting, analytics, and business decision-making. You'll work closely with both technical and non-technical stakeholders, contributing to the development of scalable data platforms and pipelines while supporting the ongoing evolution of the organisation's data capabilities. - Develop and maintain data pipelines and integration solutions - Support the design and enhancement of cloud-based data platforms - Work with stakeholders to understand and deliver data requirements - Improve data quality, reliability, and performance - Contribute to data architecture and best practice initiatives - Support the delivery of data-driven projects across the business Qualifications - Experience working as a Data Engineer or in a similar data-focused role - Strong SQL and Python skills - Experience building and maintaining data pipelines - Exposure to cloud technologies such as AWS, Azure, or GCP - Understanding of data warehousing - Strong problem-solving and stakeholder engagement skills - Commercial experience working with modern data platforms Benefits - Fully remote working - Competitive salary and benefits package - Exposure to modern technologies and data projects - Flexible working - Opportunities for professional development and progression Company Description

United Kingdom
£65K - £70K / year

Role Description Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in designing, building, and maintaining scalable and reliable data solutions on the Microsoft Azure platform. You will work closely with cross-functional teams to understand data requirements, design and implement data ingestion pipelines, perform data integration and transformation, and implement data storage and retrieval mechanisms. You will also be responsible for monitoring data pipelines and implementing data quality and governance measures. This is an exciting opportunity for a talented Data Engineer who is passionate about working with Azure technologies and wants to contribute to the success of our clients. If you have strong technical skills, a deep understanding of data engineering principles, and hands-on experience with Microsoft Azure, we would love to hear from you. - Design, develop, and implement scalable and reliable data solutions on the Microsoft Azure platform. - Collaborate with cross-functional teams to gather and analyze data requirements. - Design and implement data ingestion pipelines to collect data from various sources, ensuring data integrity and reliability. - Perform data integration and transformation activities, ensuring data quality and consistency. - Implement data storage and retrieval mechanisms, utilizing Azure services such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage. - Monitor data pipelines and troubleshoot issues to ensure smooth data flow and availability. - Implement data quality measures and data governance practices to ensure data accuracy, consistency, and privacy. - Collaborate with data scientists and analysts to support their data needs and enable data-driven insights. Qualifications - Bachelor's degree in Computer Science, Engineering, or a related field. - 5+ years of experience with Big Data technologies. - Strong knowledge and experience with Microsoft Azure cloud platform. - Proficiency in SQL and experience with SQL-based database systems. - Experience with batch and data streaming. - Proficiency in data processing frameworks such as Apache Spark, Apache Hadoop, or cloud-native data processing services (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure Synapse, Snowflake, CosmosDB). - Hands-on experience with Azure data services, such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage. - Experience using Azure Databricks in real-world scenarios. - Experience with data integration and ETL (Extract, Transform, Load) processes. - Strong analytical and problem-solving skills. - Good understanding of data engineering principles and best practices. - Experience with programming languages such as Python or Scala. - Relevant certifications in Azure data services or data engineering are a plus.

India