Senior Data Engineer
Location
United States
Posted
7 days ago
Salary
$145K - $155K / year
Seniority
Senior
Job Description
Senior Data Engineer
Claritev
Role Description This Senior Data Engineer will be part of the team responsible for developing and deploying Engineering and Integration solutions. Primary responsibility will be to work closely with the Data Architects and Machine Learning Team to implement data solutions for the organization using Python, Java, Kafka and other big data solutions, creating technical specification documents and test plans. Also provide support for the data solutions across the enterprise. Job Roles and Responsibilities - Understand business processes and how they are modeled in various systems. - Work with business users, technology teams, and executives to understand their data needs to create innovative solutions to fulfill them. - Design, organize, and implement data structures, workflows, and integrations between enterprise platforms to ensure the accurate and timely execution of business processes. - Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity. - Guide decisions and establish best practices on data integration/engineering, as well as the future of our data infrastructure. - Manage and improve the performance of our database, queries, tools, and solutions. - Create and maintain data warehouse, databases, tables, SQL queries, and ingestion pipelines to power reports (Tableau), dashboards, predictive models, and downstream analysis. - Write complex and efficient queries to transform raw data sources into easily accessible models for our teams and reporting platforms. - Prepare data for predictive and prescriptive modeling. - Identify and analyze data patterns. - Identify ways to improve data reliability, efficiency, and quality. - Work with analytics, data science, and wider engineering teams to help with automating data analysis and visualization needs, advise on transformation processes to populate data models, and explore ways to design and develop data infrastructure. - Document high and low level technical design. - Draw performance reports and strategic proposals from analyses results for senior data science leadership. - Collaborate, coordinate, and communicate across disciplines and departments. - Ensure compliance with HIPAA regulations and requirements. - Demonstrate Company's Core Competencies and values held within. - Please note due to the exposure of PHI sensitive data -- this role is considered to be a High Risk and privileged role. - The position responsibilities outlined above are in no way to be construed as all encompassing. Other duties, responsibilities, and qualifications may be required and/or assigned as necessary. Qualifications - Minimum high school diploma and five years' of relevant experience within data engineering. Bachelor's degree in computer science, information technology or a similarly relevant field is highly preferable. - Required licensures, professional certifications, and/or Board certifications as applicable. - Minimum of 3 years of experience with OOP, SQL, schema designing, data modeling, designing, building, and maintaining data processing systems. - Strong experience with advanced analytics tools for Object-Oriented/object function scripting using languages such as R, Python, Java, others. - Database development experience using SQL, SPARK, or BigQuery and experience with a variety of relational, NoSQL oriented databases like Hadoop, MongoDB, Cassandra. - Big Data Development experience using Hive, Impala, Spark, and familiarity with Kafka (preferred). - Extensive experience in triaging data issues, analyzing end-to-end data pipelines and working with business users in resolving issues. - Experience in working with data governance/data quality and data security teams and specifically data stewards and security officers in moving data pipelines into production with appropriate data quality, governance and security standards and certification. - Experience building infrastructure required for optimal extraction, transformation, and loading of data from diverse data resources. - Adept in agile methodologies and capable of applying DevOps and increasingly DataOps principles to data pipelines. - Exposure to containerization using Docker, Kubernetes etc. - Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics. - Excellent communication skills (verbal, listening and written). - Strong ability to design, build and manage data pipelines for data structures encompassing data transformation, data models, schemas, metadata and workload management. - Strong attention to detail when identifying data relationships, trends, and anomalies. - Thinking through long-term impacts of key design decisions and handling failure scenarios. - Ability to work with both IT and business in integrating analytics and data science output into business processes and workflows. - An agile learner who brings strong problem-solving skills and enjoys working as part of a technical, cross functional team to solve complex data problems. - A thought leader when approaching technical challenges. - Ability to provide mentoring to a team of data engineers. - Ability to prioritize and manage multiple projects and requests at any one time. - Ability to effectively share technical information, communicate technical issues and solutions to all levels of business. - Ability to meet strict deadlines, work on multiple tasks and work well under pressure. - Individual in this position must be able to work in a standard office environment which requires sitting and viewing monitor(s) for extended periods of time, operating standard office equipment such as, but not limited to, a keyboard, copier and telephone. Compensation The salary range for this position is $145-$155k. Specific offers take into account a candidate’s education, experience and skills, as well as the candidate’s work location and internal equity. This position is also eligible for health insurance, 401k and bonus opportunity. Benefits - Medical, dental and vision coverage with low deductible & copay. - Life insurance. - Short and long-term disability. - Paid Parental Leave. - 401(k) + match. - Employee Stock Purchase Plan. - Generous Paid Time Off – accrued based on years of service. - WA Candidates: the accrual rate is 4.61 hours every other week for the first two years of tenure before increasing with additional years of service. - 10 paid company holidays. - Tuition reimbursement. - Flexible Spending Account. - Employee Assistance Program. - Sick time benefits – for eligible employees, one hour of sick time for every 30 hours worked, up to a maximum accrual of 40 hours per calendar year, unless the laws of the state in which the employee is located provide for more generous sick time benefits. EEO Statement Claritev is an Equal Opportunity Employer and complies with all applicable laws and regulations. Qualified applicants will receive consideration for employment without regard to age, race, color, religion, gender, sexual orientation, gender identity, national origin, disability or protected veteran status. If you would like more information on your EEO rights under the law, please click here. Application Deadline We will generally accept applications for at least 5 calendar days from the posting date or as long as the job remains posted.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer, People Analytics
AirbnbAirbnb is a community based on connection and belonging.
• Collaborate with other team members and stakeholders to help understand data- and people-related business problems and translate them into scalable data solutions • Build data pipelines and tables from HR systems such as Workday, Greenhouse, and other data sources • Support Data Science team members in leveraging data for reporting, dashboard development, and other client-facing use-cases • Build, update, and maintain a production-grade data foundation that supports AI initiatives — including pipelines that feed LLM-powered tools, evaluation and feedback datasets, and the access controls and data models required to responsibly scale AI products from prototype to production • Design and deliver data products, including dashboards and reporting tools (e.g., Streamlit visualization apps), that surface actionable insights for non-technical stakeholders • Write and optimize queries across both distributed query engine (Trino/Presto) and private relational database (Postgres) • Align on priorities and work from a roadmap, ensuring you are focusing on the highest-priority projects • Assess data readiness for AI use cases, working with EX teams, Legal, and BizTech to ensure sensitive employee data is handled with appropriate governance, permissioning, and access controls • Support the transition of AI prototypes to production by building the underlying infrastructure — automated pipelines, security controls, and stable data models — that prototypes require to scale • Exercise traits of adaptability and good judgment to support organizational agility • Be a constant learner, active listener, and teacher to advance data engineering, people analytics, and Airbnb
• You will be a part of the team accountable for design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions, BigQuery) • Involvement throughout the whole process starting with the gathering, analyzing, modelling, and documenting business/technical requirements will be needed. The role will include direct contact with clients. • Modelling the data from various sources and technologies. Troubleshooting and supporting the most complex and high impact problems, to deliver new features and functionalities. • Designing and optimizing data storage architectures, including data lakes, data warehouses, or distributed file systems. Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval. Identifying and resolving bottlenecks, tuning queries, and implementing caching strategies to enhance data retrieval speed and overall system efficiency. • Identifying and resolving issues related to data processing, storage, or infrastructure. Monitoring system performance, identifying anomalies, and conducting root cause analysis to ensure smooth and uninterrupted data operations. • Train and mentor less experienced data engineers, providing guidance and knowledge transfer
Azure Data Engineer
Bluelight ConsultingBluelight is a leading software consultancy dedicated to designing and developing innovative technology that enhances users' lives. With a steadfast commitment to delivering exceptional service to our clients, Bluelight excels in its focus on quality and customer satisfaction. Our mission is not only to create cutting-edge applications but also to foster a collaborative and enriching work environment where each team member can grow and thrive. With a presence across the United States and Central/South America, Bluelight is in an exciting phase of expansion, continually seeking exceptional talent to join its dynamic and diverse community.
Role Description As an ETL Data Engineer, you will play a critical role in our client’s expanding data engineering team, designing, developing, and maintaining data integration processes primarily using Python (PySpark) and Azure Synapse Analytics to ensure the accuracy and availability of analytical data. - ETL Data Engineering: Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks, and/or Azure Synapse Analytics Pipelines, to ensure efficient data extractions, transformation, and loading. - Data Warehousing: Apply your expertise in data warehousing, understanding star schemas, facts, and dimensions, to design and build effective data storage structures in a Massively Parallel Processing (MPP) SWL Pool. - Data Source Expertise: Extract data from various sources, including REST APIs, SWL database tables, and CSV files. - Azure Synapse Analytics Expertise: Utilize your deep knowledge of Azure Synapse Analytics to design and optimize data notebooks/pipelines for scalability and performance. - Data Fabric Concepts: Contribute to the implementation and understanding of other Data Fabric concepts, such as data lakes, lakehouses, delta lakes, and data cataloging, to enhance data management capabilities. - Data Modeling: Collaborate with data architects to create data models and schemas that align with business requirements. - Data Quality: Implement data quality checks and validation processes to maintain data accuracy and consistency. - Performance Tuning: Identify and resolve performance bottlenecks and optimize ETL data notebooks/pipelines to meet SLAs. - Monitoring and Troubleshooting: Monitor ETL jobs, diagnose issues, and implement solutions to ensure data pipeline reliability. - Documentation: Maintain comprehensive documentation of ETL data engineering processes, data flows, and data transformations. - Collaboration: Work closely with cross-functional teams to understand data requirements and provide support for data-related initiatives. - Security and Compliance: Ensure data security and compliance with data governance and privacy standards. Qualifications - Bachelor’s degree in Computer Science, Information Technology, or a related field; or equivalent work experience, with certifications related to data engineering or data science (e.g. Azure Data Engineer) being a plus. - Proven experience in ETL data engineering with significant expertise in using Python (PySpark) to perform data extraction, transformation, and loading from REST APIs, SQL database tables, and CSV files. - Proficiency in using Azure Synapse Analytics resources including Notebooks, Pipelines, Linked Services, and Azure Key Vault. - Demonstrated ability to write complex SQL queries, optimize query performance, and work with both SparkSQL and MS SQL to effectively extract, transform, and load data. - Knowledge of data integration best practices and tools. - Experience with version control systems, such as Git (Azure DevOps). - Strong problem-solving and analytical skills, with a keen attention to detail. - Excellent communication skills, both verbal and written, with the ability to work collaboratively in a team environment with shifting priorities. - Familiarity with big data technologies, machine learning, and data analysis preferred. - Experience with data visualization tools (e.g. Power BI, Tableau) and Agile Methodologies a plus. Benefits - Your contributions are highly valued by clients, and the work you do often has a direct and significant impact on their business. - Opportunity to work on a variety of projects for incredible clients, which will accelerate your career growth. - Collaborate with modern technologies and work alongside some of the best professionals in the industry. Company Description Bluelight is a leading software consultancy dedicated to designing and developing innovative technology that enhances users' lives. With a steadfast commitment to delivering exceptional service to our clients, Bluelight excels in its focus on quality and customer satisfaction. Our mission is not only to create cutting-edge applications but also to foster a collaborative and enriching work environment where each team member can grow and thrive. With a presence across the United States and Central/South America, Bluelight is in an exciting phase of expansion, continually seeking exceptional talent to join its dynamic and diverse community.
Data Developer
Girl Guides of CanadaGGC is committed to diversity, equity and inclusion. We value a recruitment and selection process that is inclusive and barrier-free, and we encourage applications from people who are racialized, Indigenous, people from the 2SLGBTQI+ community, people with disabilities and other equity seeking groups. GGC welcomes girls and women – cisgender and transgender – as well as non-binary people who are comfortable in spaces that focus on and are driven by the experience of girls.
Role Description The Data Developer supports Girl Guides of Canada’s (GGC) efforts in becoming a data-driven organization. As part of the Technology and Transformation team, this role plays a critical part in supporting business as usual data needs and the Digital Transformation (DT) initiative. - Design, develop, and maintain robust data pipelines and ETL processes using Microsoft Fabric, SQL, and Python/Scala to extract, transform, and load data at scale. - Write clean, efficient, and well-documented code for data integration, transformation logic, and automation frameworks. - Develop, manage, and optimize ETL and data integration processes using Microsoft Fabric and associated components. - Design, develop, and maintain business intelligence and analytics solutions using Microsoft Power BI and related Microsoft technologies. - Build scalable, intuitive, and actionable BI reports and dashboards that support decision-making across the organization. - Collaborate closely with business teams to gather requirements and translate them into data engineering solutions and analytics deliverables. - Support the organization's Digital Transformation initiative, including data migration, data validation, and alignment between legacy and future-state data models. - Develop a deep understanding of GGC's business data across systems, becoming the go-to resource for data definitions, structures, and usage. - Ensure data quality, integrity, and consistency through validation, reconciliation, and cleansing routines in both code and automated processes. - Contribute to the implementation of GGC's data strategy and data governance framework, including maintaining data models, metadata, and business definitions. - Build analytics and reporting leveraging enterprise platforms such as CRM, member/volunteer portal, accounting, inventory, and order management systems. - Provide support, guidance, and training to enable self-service analytics and data literacy within the organization. - Stay current with emerging data engineering, BI, analytics, and Microsoft technologies, proactively recommending enhancements to GGC's capabilities. - Participate in and help establish a Data Centre of Excellence, contributing to the growth of GGC's internal data literacy and analytics maturity. - Partner with business leaders and stakeholders across departments to align analytics solutions with organizational priorities and outcomes. - Perform other data-related duties as assigned by the direct manager in support of organizational objectives. Qualifications - Post-secondary education in Computer Science, Information Systems, Data Engineering, Data Analytics, or related field, or equivalent experience. - 3+ years of experience in data engineering, ETL development, or BI solution development. - Strong proficiency in SQL and demonstrated ability to write optimized, complex queries. - Experience with Python, Scala, or other programming languages for data processing and automation. - Hands-on experience with Microsoft Fabric, Microsoft Power BI, and related Microsoft data technologies. - Experience designing, developing, and maintaining data pipelines and ETL processes. - Experience managing large-scale data platforms, ideally in digital transformation or enterprise-wide systems implementations. - Proficiency in designing and maintaining dimensional data models and star schemas. - Familiarity with data governance, data quality, data lineage, and privacy standards. - Understanding of version control systems and collaborative development practices. - Excellent communication, facilitation, and presentation skills, with experience engaging senior executives and leaders. - A creative problem solver with strong analytical and critical thinking abilities. - Customer-focused and collaborative with colleagues from all levels and departments. - Highly organized, detail-oriented, and deadline-driven. Assets - Familiarity with not-for-profit organizations, membership-based structures, or volunteer-driven environments is an asset. Requirements - Hiring Range: $80,000 to $90,000 Annually. - Application Deadline: July 1, 2026. Benefits - Submissions without a cover letter will not be considered. - Please note that GGC accepts all genders for job applications. - We encourage all candidates to apply, even if they do not meet all the job requirements. - GGC is committed to diversity, equity, and inclusion. - We value a recruitment and selection process that is inclusive and barrier-free. - GGC welcomes girls and women – cisgender and transgender – as well as non-binary people who are comfortable in spaces that focus on and are driven by the experience of girls. - Upon request, Girl Guides of Canada-Guides du Canada will make available accommodations during the recruitment process. - Accommodation requests should be made in advance to People & Culture at HR@girlguides.ca.
