Leaders in Business Intelligence and Data Solutions.
Senior Data Engineer - Qualified Pipeline
Location
United States
Posted
88 days ago
Salary
0
Seniority
Senior
No structured requirement data.
Job Description
Senior Data Engineer - Qualified Pipeline
Data Meaning
Senior Data Engineer – Qualified Pipeline Location: Remote, US based Position type: TBD Job Summary Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. Our expertise lies in delivering tailored solutions in Business Intelligence, Data Warehousing, and Project Management. We have a diverse, global team of consultants, all working remotely, embodying a collaborative, inclusive, and innovation-driven work culture. As part of our growth and upcoming initiatives, we are proactively searching for Senior Data Engineers to support future projects and platform modernization efforts across our client portfolio. Position Summary The Senior Data Engineer will play a key role in supporting the transition and modernization of the client’s data platform. The position will focus on pipeline migration, operational stabilization, and the implementation of a dbt-based transformation framework within a Snowflake environment. This role will work closely with the Lead Data Architect and the client’s engineering team, participating in knowledge transfer sessions. Key Responsibilities: - Develop and maintain ELT pipelines using Snowflake, Python, and Apache Airflow - Implement data ingestion and transformation logic for batch and incremental pipelines - Convert existing SQL transformations into dbt models - Implement dbt testing frameworks (schema, relationship, freshness tests) - Participate in pipeline walkthroughs and knowledge transfer sessions with the existing team - Document data pipelines and operational procedures - Support the transition from vendor-managed pipelines to Data Meaning ownership - Monitor production pipelines and data workflows - Troubleshoot pipeline failures and operational issues - Improve monitoring, alerting, and operational reliability - Implement automated data validation and quality checks - Support the development of a data quality framework Required Skills & Qualifications: - Advanced/fluent english - 8+ years of experience in Data Engineering - Hands-on experience with Snowflake - Experience working with Apache Airflow - Strong SQL (advanced) skills - Strong Python programming skills - Experience building: ELT pipelines, Data warehouse transformations, Batch and incremental, pipelines, Data ingestion pipelines - Experience working in cloud environments (AWS preferred) Nice to Have - Experience implementing dbt - Experience with data platform migrations - Experience with data pipeline performance optimization
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Software Engineer Sr
InsightNow is the time to bring your expertise to Insight. We are not just a tech company; we are a people-first company. We believe that by unlocking the power of people and technology, we can accelerate transformation and achieve extraordinary results. Fortune 500 Solutions Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge. Guiding organizations through complex digital decisions.
Requisition Number: 104277 Employer: Insight Direct USA, Inc. Position Location: Chandler, AZ Position: Senior Software Engineer Job Duties: - Design, implement, and maintain scalable ETL data pipelines using tools like AWS Glue, Lambda, Azure Data Factory, Logic Apps, Microsoft Fabric, and Databricks. - Develop and manage high-performance, cost-efficient data storage solutions with AWS S3, Azure Blob Storage, Aurora, Redshift, Oracle, and Snowflake. - Ensure data quality and consistency by integrating data from sources such as Oracle, SQL Server, files, cloud storage, feeds, and third-party systems. - Process and analyze large datasets using big data tools like Databricks, Microsoft Fabric, Synapse, Apache Spark, and Python/PySpark to support analytics and machine learning in AWS SageMaker. - Implement data security measures and ensure compliance with governance and regulatory standards. - Collaborate with data scientists, analysts, and stakeholders to address data needs and provide on-call technical support. - Position reports out of Chandler, AZ HQ office but telecommuting is permitted on a case-by-case basis. Job Requirements: Education Requirements: - Bachelor’s degree in Computer Science, Computer Engineering, or closely related. Employer will accept foreign degree if in the same field. Experience Requirements: - 60 months of experience in job offered, Senior Consultant, Analyst Programmer, Software Engineering Sr. Analyst, XIN-DC Senior Consultant, or closely related. Special skills requirements: - Design and implement innovative data solutions by analyzing ETL processes and leveraging AWS services such as Glue, Lambda, DMS, Redshift, Aurora and Athena. - Develop ETL/ELT jobs loading data from diverse sources such as APIs, unstructured files, Oracle, MySQL, S3, and Aurora into various target systems including Data Warehouses, Data Lakes, and reporting platforms such as Power BI and Tableau, to communicate insights to stakeholders. - Experience supporting client solutions in a wide range of business domains such as retail, investment banking, revenue recognition, telecom, healthcare and life sciences, cybersecurity, and IT, to improve existing business models involving entities like customers, accounts, orders, invoices, revenue, patients, and health providers. - Design, propose and implement automated ETL/ELT jobs using latest technologies which support profiling, governance, integration, migration and reporting from OLTP and external sources into Data Marts and Data Warehouses. - Maintained detailed technical and system documentation to support ongoing learning, training, and knowledge transfer, also provided post-implementation support, application maintenance, and techno-functional assistance to internal teams, clients, and external stakeholders. - Experienced in handling manual data feeds and generated business reports via Business Objects and utilized legacy platforms such as Teradata BTEQ, Informatica PowerCenter, MDM, BDM, and ICS. Salary: Available upon request Work Schedule: 40 hours/week Qualified applicants send cover letter and resumes to: Insight Direct USA, Inc., Susan Triggs, Insight Corporate Paralegal, susan.triggs@insight.com, ref job#FM01. EOE. Standard Benefits. #LI-DNI #FB-DNI #IN-DNI #TW-DNI #GD-DNI The position described above provides a summary of some the job duties required and what it would be like to work at Insight. For a comprehensive list of physical demands and work environment for this position, click here. Insight is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, sexual orientation or any other characteristic protected by law. Posting Notes: Chandler || Arizona (US-AZ) || United States (US) || IT Infrastructure & Support || None || US - Chandler,AZ ||
Associate Commissioner for Information & Data Management
TX-HHSC-DSHS-DFPSJoin the Texas Health and Human Services Commission (HHSC) and be part of a team committed to creating a positive impact in the lives of fellow Texans. At HHSC, your contributions matter, and we support you at each stage of your life and work journey.
Role Description The Associate Commissioner for Information and Data Management is selected by and reports to the Deputy Executive Commissioner of the Office of Data, Analytics, and Performance (DAP). This position performs advanced (senior-level) managerial activities providing direction and guidance in strategic operations and planning for the Information and Data Management department. The Associate Commissioner is responsible for governance of key data assets within and across the HHS System. Governance activities will ensure data assets are strategically utilized across HHS programs through various tactical initiatives, ensuring standardized processes are created for collecting, processing, and consuming data across all stakeholders, thereby ensuring creation of singular data definitions and formats and identification of "systems of record" for each data asset. Works with HHS agency leadership and senior management (both within business and IT) to ensure understanding of the interdependencies and impact points created by standardized and singular data assets on key business processes, including operations and analytics. Manages the change (to people, process, and technology) resulting from the creation of key data assets impacting key business processes. Collaborates with Data Trustees, Data Owners, and Data Stewards to assure data management initiatives and sustaining processes are aligned with the strategic business objectives of the system. Supports compliance with system data policies and audit of data for regulatory requirements; represents the agency on workgroups and committees to coordinate and develop HHS data policies and priorities; and makes public presentations on data governance initiatives and issues. Essential Job Functions (EJFs) - EJF. 1: In collaboration with the DAP Deputy Executive Commissioner, develops an overarching data management strategy to ensure data assets align with HHS System objectives. (20%) - EJF. 2: Develops and implements Data Governance policy and the Data Quality program. (15%) - EJF. 3: Directs data management efforts across the HHS System. (20%) - EJF. 4: In collaboration with the DAP Deputy Executive Commissioner, manages and enforces compliance with data governance policies. (15%) - EJF. 5: Coordinates interactions between program and Information Technology staff regarding changes to data structure, data quality, and metrics to ensure compliance with Data Governance policy. (10%) - EJF. 6: Assists the DAP DEC to plan and coordinate the Data Governance Council meetings, resolve emerging issues and escalate issues to the Data Governance Steering Committee as needed. (10%) - EJF. 7: Plans, assigns, and supervises the work of others. (10%) Qualifications - Knowledge of data management principles. - Knowledge of data governance principles and methods. - Knowledge of health and human service programs. - Knowledge of state and federal laws and regulations relevant to data governance activities. - Knowledge of local, state, and federal laws and regulations relevant to health and human services. - Knowledge of major information management programs within HHS. - Knowledge of big data solutions, such as Hadoop, MapReduce, HBase or others. - Skill in communicating effectively both verbally and in writing technical information to be understandable to audiences that lack specific technical knowledge. - Ability to operationalize data governance and data quality solutions. - Ability to develop and deploy best practices and methods for data governance. - Ability to manage and lead technical data teams across HHS. Requirements - A bachelor’s degree from an accredited university. - Full-time professional experience working with or in governmental entities (e.g., work with state government, federal government, a public agency, advocacy organization, etc.). - Experience in developing and presenting oral and written reports. - Experience with the Texas legislative process, including analysis of statute, rule, and budget related items. - Experience managing projects or initiatives, including strategic planning, project coordination, monitoring, maintaining schedules, and guiding teams. Benefits - 100% paid employee health insurance for full-time eligible employees. - A defined benefit pension plan. - Generous time off benefits. - Numerous opportunities for career advancement.
AWS Data Engineer (Mid/Senior)
GFT TechnologiesAs a pioneer for digital transformation GFT develops sustainable solutions across new technologies.
• Design and implement scalable cloud solutions using AWS services. • Work with distributed data architecture, focusing on data democratization (Data Mesh). • Develop robust data pipelines with Python and integrate various sources and destinations. • Collaborate with cross-functional teams in an agile environment. • Build and monitor observability solutions using Datadog (metrics, logs, traces, dashboards). • Contribute to best practices for version control (Git/GitHub), testing, and automation.
This description is a summary of our understanding of the job description. Click on 'Apply' button to find out more. Role Description The Senior Data & Platform Engineer is responsible for the day‑to‑day technical execution, reliability, and evolution of GID’s enterprise data platform. This role ensures the data foundation is scalable, secure, cost‑optimized, and ready to power analytics, AI, operational automation, and internal applications. The role spans hands‑on engineering, platform ownership, standards development, and technical leadership to accelerate data driven decision making across the organization. The Senior Data & Platform Engineer will embrace our company value of accountability, inclusiveness, energizing and courageousness. Responsibilities - Platform Ownership & Architecture - Own design architecture, reliability, and performance of the enterprise data platform—including ingestion, storage, processing, orchestration, and consumption layers. - Implement and maintain modern data stack components (e.g., Snowflake, DBT, orchestration frameworks, metadata tools, quality frameworks). - Ensure platform scalability, availability, security posture, and cost efficiency. - Pipeline Engineering & Data Products - Build and maintain analytics‑ready and AI‑ready data pipelines, transformation models, semantic layers, and shared data services. - Develop and execute a unified and forward-looking vision for data products and engineering. - Set foundation for AI use cases with implementation of semantic layer, context graphs, vector DBs, and stay current with the latest best practices. - Design and implement reusable data assets, domain models, and standardized transformation patterns. - Governance, Quality, and Controls - Establish and enforce standards for data quality, data contracts, observability, lineage, and metadata management. - Implement access controls, RBAC, PII protection, and compliance with privacy regulations (GDPR, CCPA, internal retention policies). - Partner with data governance to establish stewardship practices, certified datasets, and SLA expectations. - Collaboration & Delivery - Partner with application engineering, data scientists, data analytics units to develop data products that unlock enterprise value. - Translate business requirements into scalable data architecture and reusable technical solutions. - Drive technical prioritization, sprint planning, and execution of the platform roadmap. - Leadership & Team Development - Mentor data engineers and act as the principal technical lead for engineering best practices. - Introduce modern engineering patterns. - Create documentation standards, operational runbooks, and incident response processes. Qualifications - 7–10+ years in data & analytics engineering, platform engineering, data architecture or related technical fields. - Proven experience designing and operating modern cloud data platforms, especially Snowflake and DBT. - Strong understanding of Snowflake platform including advanced Snowflake features and Microsoft Azure, including data services, security and cost governance. - Hands‑on expertise with building data pipelines using tools such as Azure Data Factory, Fivetran, Matillion, or similar ingestion & ETL frameworks. - Proficiency in SQL, Python, and data modeling. - Strong understanding of data lifecycle management, DevOps practices, data orchestration, and production data operations. - Strong problem‑solving and systems thinking abilities. - Ability to work in fast‑moving environments with ambiguous or evolving requirements. - Excellent communication skills with the ability to simplify complexity for non‑technical audiences. - A mindset of automation, reusability, and continuous improvement. - Experience operating in organizations modernizing legacy data landscapes into a modern cloud data stack. Compensation Our company considers a range of factors including education and experience when determining base compensation. Compensation range: $175,000 - $200,000 plus 15% bonus potential. Benefits - Comprehensive benefits package, including medical, dental, vision, 401k, and PTO. - 1 hour of paid sick and safe time for every 30 hours worked. - 10 days of paid vacation time accrued bi-weekly. - 6 weeks of paid parental leave. - 10 paid holidays annually. - Up to 3 floating days.

