ShyftLabs logo
ShyftLabs

Generate Effective & Actionable Insights from your Data.

Data Engineer

Data EngineerData EngineerFull TimeRemoteSeniorTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

Canada

Posted

80 days ago

Salary

0

Seniority

Senior

Job Description

Data Engineer

ShyftLabs

• Design, build, and maintain scalable and reliable batch and real-time ETL/ELT data pipelines using cloud services such as GCP Dataflow, Cloud Functions, Pub/Sub, and Cloud Composer. • Architect and implement robust data infrastructure capable of handling high-volume data ingestion and processing. • Develop and manage our central data warehouse in Google BigQuery. • Design and implement data models, schemas, and table structures optimized for performance, scalability, and long-term maintainability. • Write clean, efficient, and maintainable SQL and Python code to transform raw data into curated, analysis-ready datasets. • Build reliable transformation workflows that support analytics, reporting, and data science initiatives. • Monitor, troubleshoot, and optimize data infrastructure to ensure high performance, reliability, and cost efficiency. • Implement BigQuery best practices, including partitioning, clustering, query optimization, and materialized views. • Build and maintain curated data models that serve as the “source of truth” for business intelligence and reporting. • Ensure data is optimized and readily accessible for BI tools such as Looker and other analytics platforms. • Implement automated data quality checks, validation rules, and monitoring frameworks to ensure the integrity and reliability of data pipelines and warehouse systems. • Establish processes for data governance, observability, and lineage tracking. • Work closely with software engineers, data analysts, and data scientists to understand their data requirements and provide the necessary infrastructure and data products. • Lead and support client and stakeholder communication, working with enterprise clients to translate business needs into scalable data solutions. • Partner with product teams and leadership to ensure that technical data solutions align with business strategy and client expectations. • Take ownership of data platforms and architecture decisions, helping shape the future direction of our analytics and data infrastructure. • Identify opportunities to improve data reliability, automate workflows, and generate new insights through data. • Contribute to a collaborative, high-performing engineering culture with strong communication and teamwork.

Job Requirements

  • 5+ years of hands-on experience in data engineering, data integration, or data platform development.
  • Degree in Computer Science, Engineering, Mathematics, or related STEM discipline.
  • Strong programming and query skills in SQL and Python.
  • Experience working with distributed version control systems such as Git in an Agile/Scrum environment.
  • Experience designing and orchestrating ETL pipelines, particularly with Databricks.
  • Experience working within cloud environments (GCP, AWS, or Azure).
  • Experience with database systems such as MongoDB and Elasticsearch.
  • Strong understanding of data warehousing and dimensional modeling methodologies.
  • Hands-on experience with Airflow and Hadoop.
  • Experience using Docker for containerized workflows and reproducible environments.
  • Ability to identify opportunities to improve data quality, reliability, and automation.
  • Strong business awareness and communication skills, with the ability to collaborate with both technical teams and business stakeholders.
  • Experience within the retail industry is a plus.

Related Categories

Related Job Pages

More Data Engineer Jobs

• Responsible for developing, expanding, and optimizing our data and data pipeline architecture • Support software developers, database architects, data analysts, and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects • Creates new pipeline and maintains existing pipeline, updates Extract, Transform, Load (ETL) process • Implements large dataset engineering: data augmentation, data quality analysis, data analytics, data profiling, and develop data strategy recommendations • Operate large-scale data processing pipelines and resolve business and technical issues pertaining to processing and data quality • Assemble large, complex sets of data that meet non-functional and functional business requirements • Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes • Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics • Work with stakeholders including data, design, product, and government stakeholders and assist them with data-related technical issues • Write unit and integration tests for all data processing code • Work with DevOps engineers on CI, CD, and IaC • Read specs and translate them into code and design documents • Perform code reviews and develop processes for improving code quality.

Maryland
$113.2K - $127.9K / year
ICF logo

Data Architect / MuleSoft Integration & Migration Specialist (Remote)

ICF

Founded in 1969, ICF is a global advisory and technology services company headquartered in Reston, Virginia. It delivers data-driven solutions across energy, environment, infrastru

Data Engineer80 days ago

Description Please note: This role is contingent upon contract award. While it is not an immediate opening, we are actively conducting interviews and extending offers in anticipation of the award. Title: Data Architect / MuleSoft Integration & Migration Specialist The Work: ICF is seeking a seasoned Data Architect with expertise in MuleSoft integration and data migration to lead the design and implementation of scalable data solutions for a Salesforce Government Cloud Platform deployment. This role will ensure seamless integration with external systems, secure and compliant data migration from legacy platforms, and long-term sustainability of the data architecture. Job Location: Remote work is authorized. Must support US Eastern time zone working hours. What You Will Do - Develop and maintain integration solutions using MuleSoft and Salesforce-native tools (e.g., Salesforce Flow, Data Loader). - Collaborate with stakeholders, Business Analysts, and development teams to define data models, integration flows, and technical specifications. - Design and implement scalable, secure data architectures aligned with DHS and federal compliance standards (e.g., NIST, FISMA). - Lead data migration efforts from legacy systems to Salesforce, ensuring data integrity, accuracy, and completeness. - Perform data mapping, cleansing, transformation, and validation to support migration and integration workflows. - Write and optimize ETL scripts (e.g., SQL, Apex, Python) for data extraction, transformation, and loading. - Support the Authorization to Operate (ATO) process by contributing to cybersecurity documentation and ensuring compliance with DoD and federal security standards. - Provide technical guidance on data governance, data quality, and integration best practices. - Create and maintain technical documentation, including migration plans, integration specifications, and gate review deliverables. - Participate in Agile ceremonies (e.g., sprint planning, daily stand-ups) to align with team goals and timelines. - Troubleshoot and resolve data or integration issues post-deployment to support ongoing system maintenance. What You Will Bring With You - 6+ years of experience in data architecture, migration, and integration development. - 3+ years of experience specifically with Salesforce integration and data migration projects. - Active MuleSoft technical certification (e.g., MuleSoft Certified Developer or Integration Architect) - Candidate must have a Public Trust or an Active Secret clearance. - U.S. Citizenship is required due to federal contract requirements. - Candidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.S. - Candidate must have lived in the U.S. for three (3) full years out of the last five (5) years. What We Would Like You To Bring With You: - Salesforce Certified Platform Integration Architect or Salesforce Administrator certification. - Experience working with federal government clients, particularly DHS or DoD. - Familiarity with Salesforce, including its general functionality and the use cases it supports. - Proficiency with Salesforce development and data management tools (e.g., VS Code, Salesforce CLI, Workbench, Data Loader). - Strong scripting skills in SQL, Apex, or Python for ETL processes. - Deep understanding of federal security and compliance frameworks (e.g., NIST, FISMA). - Excellent communication and documentation skills, with the ability to collaborate across technical and non-technical teams. - Background in data migration projects. Professional Skills: - Highly effective analytical and problem-solving capabilities. - Demonstrated critical thinking, attention to detail, and the ability to produce polished and well-organized written deliverables. - Excellent communication and interpersonal skills to interface effectively with team members and federal clients. - Organized, detailed oriented and able to prioritize and multi-task. Working at ICF ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future. We can only solve the world's toughest challenges by building a workplace that allows everyone to thrive. We are an equal opportunity employer. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO policy. We will consider for employment qualified applicants with arrest and conviction records. Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation, please email Candidateaccommodation@icf.com and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.  Read more about workplace discrimination rights or our benefit offerings which are included in the Transparency in (Benefits) Coverage Act. Candidate AI Usage Policy At ICF, we are committed to ensuring a fair interview process for all candidates based on their own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) tools to generate or assist with responses during interviews (whether in-person or virtual) is not permitted. This policy is in place to maintain the integrity and authenticity of the interview process.  However, we understand that some candidates may require accommodation that involves the use of AI. If such an accommodation is needed, candidates are instructed to contact us in advance at candidateaccommodation@icf.com. We are dedicated to providing the necessary support to ensure that all candidates have an equal opportunity to succeed.   Pay Range - There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position. The pay range for this position based on full-time employment is: $98,614.00 - $167,644.00 Nationwide Remote Office (US99)

United States
$98.6K - $167K / year
Job Closed
Impact Advisors logo

AI/Data Governance Epic, Enterprise Systems & AI Governance

Impact Advisors

Trusted, focused healthcare experts delivering value, innovation and improved performance

Data Engineer80 days ago
OtherRemoteTeam 501-1,000Since 2007H1B Sponsor

Impact Advisors, LLC is a nationally recognized healthcare management consulting firm delivering Best in KLAS advisory, implementation, and optimization services. We are driven by a commitment to exceed client expectations and are proud to be a trusted partner to many of the nation's leading healthcare organizations. Our mission to drive patient-centered, value-driven outcomes has earned us prestigious industry accolades. To learn more about us, visit www.impact-advisors.com The Data Governance Engagement Lead provides enterprise‑level leadership for data governance across Epic EHR and core enterprise systems ( HCM/Financials, ERP, supply chain, analytics platforms), with a specific mandate to establish and mature AI/data governance capabilities. This role is designed for a healthcare provider organization in the early‑to‑medium stages of AI adoption, where AI tools, predictive analytics, and automation are emerging but require formal governance, structure, and oversight. The Engagement Lead defines standards, operationalizes governance processes, and guides the organization from ad hoc AI usage toward consistent, responsible, and scalable practices. Enterprise & Epic Data Governance Leadership​ - Serve as a lead governance authority for clinical, operational, workforce, and financial data across Epic and enterprise platforms.​ - Define and enforce enterprise data standards, ownership models, and system‑of‑record decisions spanning Epic, ERP vendors, and downstream analytics platforms.​ - Partner with Epic application teams to govern data flowing through Clarity, Caboodle, and enterprise data warehouses, ensuring traceability and consistency.​ Governance Maturity Development - Lead the foundational build‑out of AI governance, moving the organization from informal or pilot-based AI usage toward documented, repeatable governance processes.​ - Establish baseline AI governance artifacts, including:​ - AI intake and use‑case documentation​ - Data source and provenance documentation​ - Risk, bias, and limitation awareness statements​ - Partner with analytics, data science, compliance, and operational leaders to ensure AI initiatives align with organizational goals, patient safety expectations, and regulatory requirements.​ Data Quality, Metadata, & Lineage (Cross-System)​ - Lead enterprise efforts to improve data quality, metadata, and lineage across clinical and non-clinical systems.​ - Ensure datasets supporting analytics and AI are well‑defined, validated, and fit for intended use.​ - Guide remediation of systemic data quality issues impacting reporting, AI performance, or clinical decision support.​ Enterprise Systems Governance​ - Provide governance leadership for enterprise system data including workforce, payroll, finance, supply chain, and organizational hierarchies sourced from Workday and ERP platforms.​ - Define integration governance between Epic and enterprise systems (e.g., provider attributes, staffing, cost centers).​ - Partner with HR and Finance leaders to establish consistent definitions and trusted enterprise reporting.​ Risk, Privacy & Regulatory Alignment​ - Ensure AI and data governance practices align with HIPAA, CMS, Joint Commission, and emerging AI oversight expectations.​ - Support governance controls to prevent “shadow AI” usage, unmanaged automation, or undocumented analytics operating outside approved workflows.​ - Collaborate with Privacy, Security, and Compliance teams to balance innovation with risk mitigation.​ Requirements - REQ: 7–10 years of experience in healthcare data governance, data management, analytics, or health IT.​ - REQ: Strong experience working with Epic EHR data and reporting environments (Clarity, Caboodle, or EDW).​ - REQ: Demonstrated experience establishing or maturing data governance or AI governance processes in organizations that are not yet fully mature. ​ - OPT: Experience governing or supporting enterprise platforms such as Workday HCM/Financials, ERP, or other supply chain systems.​ - OPT: Experience operating within an AI governance maturity model ​ - OPT: Exposure to AI oversight concepts such as model transparency, bias awareness, data provenance, and post-deployment monitoring.​ - OPT: Experience in large health systems, IDNs, or academic medical centers. - BA/BS in Health Informatics, Information Systems, Data Management, Healthcare Administration, or related field.​ - Master’s degree preferred by not required. - - Advanced understanding of healthcare data governance frameworks.​ - Working knowledge of SQL and analytic data structures.​ - Familiarity with AI governance concepts and emerging healthcare guidance (e.g., intake workflows, documentationstandards, risk assessments).​ - Ability to translate governance principles into practical, scalable operating processes. For salaried positions, this role may also be eligible for an annual performance bonus. Additional benefits and perks may also be available, depending on the position and employment terms. This range reflects consideration of several factors, including skills, experience, training, certifications, and organizational needs. Our People and Culture At Impact Advisors, we cultivate a caring, fun, honest, and autonomous work environment. Our success stems from our associates' dedication and a shared mission to create a “Positive Impact.” We embrace diversity and inclusion, fostering an environment where all employees feel valued and empowered. Join Impact Advisors and make a real difference in healthcare.

United States
OtherRemoteTeam 501-1,000Since 2022H1B No Sponsor

About Us Hydrafacial is a global category-creating company focused on bringing innovative products to market and delivering beauty health experiences by reinventing our consumer’s relationship with their skin, their bodies and their self-confidence. Every person here is a key player in our success. We are firm believers in making the little things count each day so the big things will follow. If this sounds like you, come check us out! This is the perfect opportunity to work with some of the best leaders in the industry while you gain the global and strategic experience to add to your professional toolbox. Job Description: Hydrafacial is seeking a Senior Data Engineer to lead BI development and elevate our Power BI architecture, data modeling standards, and engineering discipline. This is a hands-on technical leadership role responsible for building scalable semantic models, modernizing development practices, mentoring developers, and establishing strong governance and operational visibility across the BI function. The ideal candidate is first and foremost an exceptional Power BI developer who also understands that high-performing analytics teams require structured processes, clear documentation, measurable delivery metrics, and disciplined service management practices. What you’ll do: Primary Responsibilities: Power BI Architecture & Development - What You Need to Know: - This role sets the standard for BI development practices, documentation, and delivery transparency. - Strong operational reporting and pipeline visibility are key components of success. - You will operate in an environment that values reliability, accountability, and disciplined change management. BI Development Leadership & Standards - Lead and mentor BI developers while establishing architectural and coding standards. - Implement structured development workflows using PBIP and Git-based version control. - Conduct design and code reviews to ensure quality, consistency, and performance. - Embed documentation and governance practices into the development lifecycle. Development Pipeline & Delivery Governance - Manage BI development backlog and priorities. - Track and report on delivery metrics, pipeline health, and release status. - Provide clear, executive-ready updates on initiative progress and risks. - Analyze team performance to improve efficiency and throughput. Development Pipeline & Delivery Visibility - Lead structured requirement gathering and solution design processes. - Produce and maintain clear technical and functional documentation that supports scalability, audit readiness, and knowledge transfer. - Document data models, business logic, calculation methodologies, and deployment processes. - Embed documentation and review checkpoints into the development lifecycle. Service & Operational Excellence - Operate within formal service management frameworks. - Manage BI-related incidents, requests, and changes through structured tracking systems. - Ensure production stability, reliability, and continuous improvement. Customer-Focused Analytics - Develop KPI frameworks that improve service performance and customer satisfaction. - Enable proactive monitoring and root cause analysis. - Increase automation to improve reporting efficiency. What you need to know: Experience/Skills/Education: Required: - 6+ years of enterprise BI experience. - Advanced Power BI expertise: - Complex DAX development - Semantic model design and optimization - Star schema data modeling - Performance tuning large datasets - Row-level security implementation - Experience working with Snowflake or other enterprise cloud data platforms. - Strong SQL skills. - Experience implementing Power BI Projects (PBIP). - Experience using Git-based version control systems. - Demonstrated experience producing structured technical and solution documentation. - Experience working within formal IT service management environments. - Experience managing development backlogs and providing delivery status reporting. - Experience leading or mentoring BI developers. - Excellent verbal and written communication skills. - Strong customer-service mindset. Desired: - Experience modernizing or scaling BI functions within a growing organization. - Familiarity with DevOps principles and CI/CD practices for analytics solutions. - Experience improving enterprise data models in partnership with data engineering teams. - Experience applying AI or advanced analytics techniques within reporting and analytics environments (e.g., automation, anomaly detection, predictive insights, AI-assisted development workflows). - Exposure to modern productivity or AI-assisted development tools. - Industry certifications (Power BI, Azure, ITIL, or related). - Experience supporting global or publicly traded organizations. We mean it when we say you’ll LOVE this role. ​Base Pay: $121,000 - $140,000 + Bonus An employee’s pay position within the salary range will be based on several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, travel requirements, revenue-based metrics, any contractual agreements, and business or organizational needs. The range listed is just one component of Hydrafacial's total rewards package for our employees. Other rewards may include annual bonuses, long-term incentives based on level, paid time off, and region-specific benefits. Come grow and GLOW with us! What else can you expect with Hydrafacial? PERKS! Benefits include: Medical insurance, dental insurance, vision insurance, FSAs, HSAs, accident insurance, pet insurance, company-paid life and AD&D insurance, company-paid long-term and short-term disability insurance, 401(k) with employer match, paid time off (PTO), and paid holidays. Hydrafacial is proud to be an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, sex, religion, sexual orientation, national origin, gender identity, gender expression, age, disability, genetic information, pregnancy or any other protected characteristic as outlined by color, federal, state or local laws. We are committed to working with and providing accommodation to applicants with physical and mental disabilities. Hydrafacial does not accept unsolicited assistance or resumes/CVs from third party search firms. No fee will be paid in the event a candidate is hired by our company as a result of an agency referral or CV/resume submitted by a search firm to any employee at our company without a valid written search agreement. If we need additional support, we will be sure to reach out directly to one of our preferred providers. Please no phone calls or emails.

United States
$121K - $140K / year
Job Closed