Remote Recruitment Agency®. Find your next superstar remote developer in under 3 weeks.
Senior Data Engineer
Location
North America
Posted
66 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
DistantJob
• Design, build, and optimize complex SQL Server solutions, emphasizing performance tuning, indexing, and data modeling. • Manage relational and semi-structured data, including JSON stored in SQL Server and multi-dimensional datasets. • Query and transform JSON using native SQL Server tools, such as OPENJSON and JSON_VALUE. • Use PowerShell, SQL Server tools, and scripting to automate processes. • Enhance functionalities by integrating with APIs and external systems. • Address problems comprehensively, focusing on end-to-end solutions beyond the database layer. • Operate within a complex, multi-system application environment, avoiding isolated reporting or analytics tasks. • Explore and implement LLM-driven workflows, including prompting and structured outputs. • Continuously enhance efficiency by replacing manual processes with automation.
Job Requirements
- Proficient in SQL Server, including query performance, indexing, and data modeling.
- Experience handling JSON in SQL Server and managing hybrid data models.
- Experience with PowerShell or similar scripting languages for automation purposes.
- Ability to work across multiple systems, including databases, APIs, and services.
- Proven ability to deliver effective solutions in a timely manner.
- Background in smaller teams with end-to-end system ownership.
- Experience in complex application environments rather than isolated reporting or analytics settings.
- Capability to navigate and solve problems without detailed requirements.
- Experience in insurance, financial services, or other regulated, transaction-heavy domains.
- Python experience and familiarity with APIs and integrations.
- Exposure to LLMs like OpenAI and Claude.
- Experience developing internal tools or automation frameworks.
- Experience with cloud or hybrid infrastructure.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer - Operations
UnitedHealth GroupUnitedHealth Group is a healthcare and well-being company that’s dedicated to improving the health outcomes of millions around the world. We are comprised of
Role Description As a member of the Optum team, you will: - Gather and prepare analysis based on information from internal and external sources to evaluate and demonstrate program effectiveness and efficiency, and problem solving. - Develop scalable reporting processes and querying data sources to conduct ad hoc analyses/detailed data profiling. - Research complex functional data/analytical issues, demonstrating good troubleshooting skills. - Assume responsibility for data integrity among various internal groups and/or between internal and external sources. - Take end-to-end responsibility quickly solving data issues in a production setting. - Manage End‑to‑End Operational Ownership. - Run Monitoring & Issue Management. - Facilitate Stakeholder Communication & Coordination. - Ensure Change and Release Readiness. - Leverage enterprise-approved AI tools to streamline workflows, automate tasks, and drive continuous improvement. You’ll be rewarded and recognized for your performance in an environment that will challenge you and provide development for other roles you may be interested in. Qualifications - Bachelor’s degree. - 3+ years of experience with SQL. - 2+ years of experience with Kafka, Databricks, Github, Airflow, and Azure or other public cloud platforms. - 2 years of experience with Metrics & Operational Reporting. Requirements - Good understanding of healthcare data. - Aptitude for learning new data flows quickly and participating in data quality and automation discussions. - Willingness to use AI tools and look for opportunities to use AI. Benefits - Comprehensive benefits package. - Incentive and recognition programs. - Equity stock purchase. - 401k contribution (subject to eligibility requirements). The salary for this role will range from $91,700 to $163,700 annually based on full-time employment. Company Description At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone–of every race, gender, sexuality, age, location, and income–deserves the opportunity to live their healthiest life. - Committed to mitigating our impact on the environment. - Enabling and delivering equitable care that addresses health disparities and improves health outcomes. - Equal Employment Opportunity employer under applicable law. - Drug-free workplace; candidates are required to pass a drug test before beginning employment.
Senior Engineer, Big Data
Molina HealthcareMolina Healthcare is a Fortune 500 managed care company with a storied history that dates back to 1980 and the opening of a medical clinic by Dr. C. David Molin
Role Description Responsible for all the aspects of architecture, design and implementation of Data Management solution using Big Data platform on Cloudera or Hortonworks and other areas of enterprise application platforms. - Convert concepts to technical architecture, design and implementation - Provide guidance on choosing ideal Architecture, Evaluating tools and Frameworks, define Standards & Best Practices for implementing scalable business solutions - Implement Batch and Real-time data ingestion/extraction processes through ETL, Streaming, API, etc., between diverse source and target systems with structured and unstructured datasets - Design and build data solutions with an emphasis on performance, scalability, and high-reliability - Code, test, and document new or modified data systems to create robust and scalable applications for data analytics - Build data model for analytics and application layers - Contribute to leading and building a team of top-performing data technology professionals - Help with project planning and scheduling - Expert level experience on Hadoop cluster components and services (like HDFS, YARN, ZOOKEEPER, AMBARI/CLOUDERA MANAGER, SENTRY/RANGER, KERBEROS, etc.) - Ability to participate and lead, in solving technical issues while engaged with infrastructure and vendor support teams. Qualifications - Bachelor's Degree - 5-7 years of data management experience. - Experience in building stream-processing systems, using solutions such as Kafka, Storm or Spark-Streaming. - Proven experience on Big Data tools such as, Spark, Hive, Impala, Polybase, Phoenix, Presto, Kylin, etc. - Experience with integration of data from multiple data sources (using ETL tool such, Talend, etc.). - Experience building solutions with NoSQL databases, such as HBase, Memsql. - Strong experience on Database technologies, Data Warehouse, Data Validation & Certification, Data Quality, Metadata Management and Data Governance. - Experience with programming language such as, Java/Scala/Python, etc. - Experience implementing Web application and Web Services APIs (REST/SOAP). Requirements - Master's Degree (Preferred) - 7-10 years of data management experience (Preferred) - Experience in the healthcare industry is preferred. Benefits Molina Healthcare offers a competitive benefits and compensation package. Company Description Molina Healthcare is an Equal Opportunity Employer (EOE) M/F/D/V.
Lead Data Engineer – Platform
ValtechA pioneer in the fields of digital and technology, Valtech is a global business-transformation agency that was founded in 1993 to deliver "innovation with a pur
• Design, build, and maintain scalable data engineering frameworks and platform utilities used across engineering teams • Develop reusable patterns, templates, and abstractions to standardise and accelerate delivery • Define and evolve platform architecture decisions, ensuring scalability, maintainability and consistency • Design and implement CI/CD pipelines and automation frameworks to improve engineering velocity • Define and enforce engineering standards for testing, code quality, deployment and documentation • Identify and eliminate manual or repetitive processes through automation and tooling improvements • Integrate AI-assisted development tools into engineering workflows to improve productivity • Develop and maintain AI engineering assets such as coding guidelines, prompt frameworks and reusable agent configurations • Lead the development and operational support of core data transformation frameworks (including dbt Core at enterprise scale) • Investigate and resolve framework-level issues, including deployment failures, dependency conflicts and production incidents • Support onboarding and enablement of engineering teams adopting platform tooling • Act as the main technical point of contact for platform and framework-related queries • Partner with engineering teams to identify pain points and translate them into platform improvements • Ensure platform tooling meets security, compliance and operational requirements • Conduct and support code and design reviews across platform components • Monitor platform health, performance and adoption, iterating based on feedback and metrics • Contribute to documentation, developer guides and enablement materials to improve usability and adoption
Snowflake Data Engineer
Keyrus PortugalKeyrus is a global consulting and technology company focused on making data matter — truly matter — from a human perspective. Founded in 1996, Keyrus operates in 28+ countries across 5 continents, with more than 3,300 people worldwide. Our strength comes from combining deep expertise in Data & Analytics, AI, Digital, and Management Consulting with a strong understanding of business realities. At Keyrus, we also believe companies have a responsibility beyond performance. Through our Foundation and ESG initiatives, we actively contribute to sustainability, inclusion, and positive societal impact.
Role Description As a Snowflake Data Engineer, you will work at the intersection of data, technology, and business, helping our clients modernise enterprise data platforms and accelerate their cloud transformation journeys. You will contribute to a large-scale international data migration program within the insurance sector, supporting the transition from legacy Hadoop/Hive ecosystems to a modern Snowflake-based architecture. You will collaborate with multidisciplinary teams in an international environment and contribute to projects that drive performance, innovation, and scalable data solutions. Your Impact - Participate in enterprise-scale migration projects from Hadoop/Hive to Snowflake; - Design and develop ETL/ELT pipelines for batch and near real-time ingestion; - Develop scalable and optimised Snowflake data models and transformations; - Work with technologies such as Snowflake, SQL, Python, PySpark, Snowpark, Spark, and Databricks; - Ensure data quality, consistency, governance, and security throughout migration activities; - Collaborate with architects, engineers, and business stakeholders across international teams; - Contribute to modernisation initiatives and cloud transformation programs; - Support continuous improvement and optimisation of enterprise data platforms. What Makes This Role Challenging - You will work in complex, evolving enterprise environments; - You will contribute to large-scale modernisation and migration initiatives; - You will balance technical delivery, optimisation, and governance requirements; - You will collaborate with multicultural and cross-functional teams; - The role requires autonomy, ownership, and strong problem-solving capabilities. Qualifications - Minimum 5 years of experience as a Data Engineer or similar role; - Strong hands-on experience with Snowflake, including: - Data modelling; - Performance optimization; - Security implementation; - Proven experience in data migration and modernisation projects; - Strong SQL expertise and experience with analytical databases; - Hands-on experience with Dataiku or similar data integration tools; - Experience with Python, PySpark, and Snowpark; - Experience with distributed processing frameworks such as Spark or Databricks; - Strong analytical and problem-solving skills; - Ability to communicate clearly with both technical and non-technical stakeholders; - A collaborative mindset and strong sense of ownership; - Professional proficiency in French; - Fluency in English; - Must be a Portuguese or European citizen, or hold a valid work permit for Portugal. Nice-to-haves - Experience within insurance or other highly regulated industries; - Experience with dbt; - Experience with cloud environments (Azure and/or AWS); - Familiarity with CI/CD and DevOps practices for data platforms; - Exposure to Data Vault 2.0 methodologies; - Experience in consulting environments; - Exposure to international or multicultural projects. Benefits - Competitive salary aligned with your experience and the data market; - Meal allowance: €10.20/day; - Flexible benefits plan; - Private medical insurance; - 22 days of annual leave, increasing every 3 years (up to 25 days); - Continuous learning via KLX – Keyrus Learning Experience; - A collaborative, international, and human-centred work environment. Equal Opportunity Statement We are committed to building an inclusive workplace and encourage applications from all backgrounds, regardless of race, ethnicity, gender identity, sexual orientation, age, disability, or any other protected characteristic.

