Data Engineer

Location

United States

Posted

47 days ago

Salary

0

Seniority

Mid Level

Job Description

Data Engineer

Data Society

About Data Society Group At Data Society Group, we provide the highest quality, leading-edge, industry-tailored data and AI training and solutions for Fortune 1,000 companies and federal, state, and local governmental organizations. We partner with our clients to educate, equip, and empower their workforces with the skills they need to achieve their goals and expand their impact. Our portfolio of brands and services sits at the intersection of people, data, and AI and consists of: - CDO Magazine, the trusted voice of global data and AI leadership - The Data Lodge, a pioneer in data literacy and cultural transformation - Data Society, delivering applied AI education and custom-built solutions - InspiredMinds!, a convening force behind the world’s most inclusive AI community We are working to empower the workforces of the future; if you’re as passionate about transforming workplaces with the power of Data & AI as we are, we’d love to hear from you! About the Role The Data Engineer is responsible for building scalable, performant data pipelines that power critical operational and analytical applications. The engineer must be able to work closely with our data science teams to build the supporting data scaffolding to orchestrate, test, and monitor data systems. This is a customer-facing role within a cross-functional team so the ability to manage timelines, work both autonomously and collaboratively, and communicate effectively are a must. As this position will help to support federal contracts with security requirements, you must be a US Citizen to qualify. Occasional travel to client offices in Richmond, VA will be required, and preference will be given to local DMV area candidates. This is a full-time, remote/work from home, benefits eligible position. Responsibilities: - Ability to build a full data pipeline from data ingestion to processing/transformation to load to visualization and analysis. - Design and manage large-scale data warehouses, lakehouses, and/or data marts - Build and optimize data transformation pipelines using tools like dbt to support data flow from ingestion through analytics - Champion data governance principles and quality standards, ensuring data lineage, documentation, and metadata are maintained - Create efficient, performant SQL-based data queries and Python-based data processing jobs - Demonstrate ability to balance computational load, performance, and cost Skills you bring: - Advanced Degree in Statistics, Applied Mathematics, Data Science, Computer Science, Operations Research or other closely related other quantitative or mathematical disciplines. - 5+ years of data and analytics engineering in cloud environments - Expertise in SQL, Python, and schema design with experience in data cataloging and governance tools - Experienced with data transformation and ETL best practices - Experienced with data orchestration tools like Airflow, transformation frameworks like dbt, and cloud deployment tools like Terraform. - Demonstrated exceptional oral and written communication skills. - The ability to work independently and in a team environment. - The ability to work effectively across functions, levels and disciplines. - Strong problem solving and critical thinking skills. - Superior team-working skills, and a desire to learn, contribute, and explore. - Experience with Snowflake, Databricks, Kafka, Flume, Spark, or Flink is a plus Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 1,001-5,000H1B No Sponsor

Join us in advancing safer, consistent, quality healthcare for all. Job Summary: Under the direction of the Manager or Senior Manager, the Senior Clinical Data Specialist plays a vital role in delivering quality solutions to hospital partners across the country, approaching each hospital engagement as an opportunity to apply your expertise with precision. This is a unique opportunity to become a part of our team during a milestone moment in our growth, benefiting from our deep cancer registry experience and employee-centric leadership. Roles and Responsibilities: - Apply specialized, clinical knowledge to hospital partners: categorize, code, summarize, interpret and calculate registry/case information from nuanced, patient medical records. - Ensure quality submission of all data in specified registries or measure data repositories, maintaining a high accuracy threshold. - Prioritize, organize, and meet tight deadlines for multiple concurrent tasks and team requests; uses tact and judgement to manage expectations, flag obstacles and propose solutions in a timely manner. - Navigate new technical systems: electronic medical records (EMR) and registry/case entry tools; use team resources to troubleshoot technical issues with systems and applications with a focus on solutions. - Contribute to team best practices, data dictionaries, abstraction guidelines, and other business rule documents; identifies process improvement opportunities to help streamline tasks and processes. - Keeps up to date on mandated regulatory/publicly reported data requirements as specified by federal, state, payer and other agencies. - Any or other additional responsibilities as assigned Required Skills and Abilities: - Strong analytical and critical thinking skills to approach problems in a systematic method using the ability to synthesize data and suggest recommendations - Demonstrates high standards for accuracy and attention to detail - Demonstrates technical savvy and strong desire to learn new systems and technology - Intermediate proficiency with MS Office (Microsoft Excel) - Thrives working independently and takes ownership of projects/patient records - Consistently and clearly communicates, adjusting style and tone as needed to effectively collaborate with hospital partners, peers, team leads and others - Demonstrates strong self-organizational and time management skills to concurrently manage multiple accounts, adjusting as needed to shifting timelines and priorities - Adapts to changes in hospital partner timelines, requirements, and project assignments - Maintains a high degree of responsibility in keeping PHI secure and confidential - Applicants for employment with Q-Centrix must be legally authorized to work in the United States now or in the future without sponsorship. Education and Experience: - Direct abstraction experience within the STS General Thoracic (GTS) or Adult Cardiac (ACS) registry within the last 12 months. - Exposure to multiple patient medical record systems (EMRs) and clinical databases. - Direct clinical experience (preferred). - RN or LPN Credential or substantial clinical experience (preferred). Total Rewards: At Q-Centrix, our purpose—safer, consistent, quality healthcare for all—drives everything we do. To accomplish this important work, we need to attract, engage, and retain a talented team by providing a compelling, equitable rewards package comprised of an inclusive culture, flexible work environment, learning and development opportunities, competitive pay that rewards high performance, and robust benefits that support health and financial wellness. Add to this package a supportive community of people who help each other not only do meaningful work, but learn, grow, and have fun while doing so, and you get an organization that has earned the Great Place to Work distinction multiple years in a row!​ The target wage range for this role is $27.00 - $32.00 per hour. Individual wage rates within this range are based on multiple factors including but not limited to skills, experiences, licensure, certifications, and other business and organizational considerations. Wage ranges are reviewed, at minimum, annually and all team members are eligible for performance-based wage rate increases annually. The Q-Centrix compensation plan is productivity and accuracy focused, therefore, actual compensation could be higher or lower than target, dependent upon the team member’s performance. In addition to our inclusive and innovative working environment and competitive pay, part-time* team members enjoy a fully remote work environment with a flexible schedule. *Team members who are committed to work 29 hours or fewer each week are considered part-time Commitment to Diversity, Equity, Inclusion and Belonging: At Q-Centrix (An MRO Company), we hire people who love learning, value innovation, and believe in our purpose of safer, consistent, quality health care for all. We applaud qualified applicants who are accountable and committed to producing quality work. As an Equal Opportunity Employer, we support and value diversity, dignity, and respect in our work environment, and are committed to creating an inclusive environment in which everyone can thrive. We employ people based on the needs of the business and the job, and their individual professional qualifications. Here’s what does not impact our employment decisions: race, religious creed, religion, color, sex, sexual orientation, pregnancy, parental status, genetic information, gender, gender identity, gender expression, age, national origin, ancestry, citizenship, protected veteran or disability status, health, marital, civil union or domestic partnership status, or any status or characteristic protected by the laws or regulations in locations where we operate. If you are an individual with a qualified disability and you need an accommodation during the interview process, please reach out to your recruiter. Candidate Privacy Statements

United States
$27 - $32 / hour
Cloudera logo

Principal Engineer -- Data Fabric

Cloudera

At Cloudera, we believe that data can make what is impossible today, possible tomorrow.

Data Engineer47 days ago
Full TimeRemoteTeam 1,001-5,000Since 2008H1B Sponsor

Business Area: Engineering Seniority Level: Director Job Description: At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises. As a principal engineer in the team building a modern data fabric that provides unified metadata, governance, access control, data quality and data sharing capabilities across a diverse set of data systems, you will drive architecture, design, implementation and integrations, and influence requirements. You will work closely with architects, developers, platform teams, UI/UX designers and product managers to build scalable services that integrate with databases, data lakes, streaming services, and enterprise applications. As a Principal Engineer you will: - Drive design and implementation of services and microservices that form the core of the data fabric platform, ensuring scalability, reliability, security and performance. - Drive best practices for data lineage, observability, and quality, enabling trust and traceability across data pipelines. - Lead cross team initiatives, provide guidance, design reviews and hands-on contributions. - Collaborate closely with product managers to translate business requirements into robust technical solutions. - Mentor senior and mid-level engineers, to raise the technical bar across the organization. - Influence long-term platform roadmap and technical strategy. We are excited if you have: - 10+ years experience building large-scale, distributed systems, with a strong focus on data platforms - Deep understanding of practical data fabric concepts, including: - data pipelines and orchestration - Metadata management and lineage - Data quality and observability - Authorization, access control, auditability, data sharing - Expert-level Java experience, with a strong grasp of concurrency, performance tuning, and building micro-services. - Extensive experience with large scale data processing/analyzing systems, such as: - Distributed compute engines like Spark, Trino, Flink - Data storage systems like HDFS, object stores, data lakes - Messaging and streaming platforms like Kafka - Strong knowledge of distributed system design: consistency, scalability, fault tolerance and operability. - Proven ability to lead technically, influence architecture and deliver complex systems in production. You might also have: - Experience building or integrating data governance, authorization, or policy engines. - Familiarity with metadata platforms and standards (e.g., data catalogs, lineage frameworks). - Experience with cloud-native architectures and Kubernetes-based deployments. - Strong written and verbal communication skills, with the ability to explain complex systems clearly. The expected base salary range for this role in - California is $248,000 - $310,000 The salary will vary depending on your job-related skills, experience and location What you can expect from us: - Generous PTO Policy - Support work life balance with Unplugged Days - Flexible WFH Policy - Mental & Physical Wellness programs - Phone and Internet Reimbursement program - Access to Continued Career Development - Comprehensive Benefits and Competitive Packages - Paid Volunteer Time - Employee Resource Groups EEO/VEVRAA #LI-SZ1 #LI-REMOTE

France
$248K - $310K / year
Full TimeRemoteTeam 1,001-5,000

We Impact Lives Through Purpose-Driven Work in A People First Culture Ascend Learning, a leading healthcare and learning technology company, is the connection between a powerful portfolio of brands serving students, educators, and employers with outcomes-based, data-driven solutions across the lifecycle of learning. From testing to certification, Ascend Learning products are used by physicians, emergency medical professionals, nurses, allied health professionals, certified personal trainers, financial advisors, skilled trades professionals and insurance brokers. Headquartered in Burlington, MA, with additional office locations and hybrid and remote workers in cities across the U.S., Ascend Learning was recognized by Newsweek and Plant-A Insights Group as one of America’s 2025 Greatest Workplaces as well as America’s Best Places to work for Mental Well-Being for 2025.  We're always looking for talented, passionate professionals to join us in our mission to help change lives. If this sounds like an environment where you'd thrive, read on to learn more.  WHAT YOU'LL DO As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable and robust data pipelines and architectures. You will play a critical role in enabling data-driven decision-making by ensuring the availability, integrity, and performance of our data systems. You will work closely with business intelligence team, data scientists, and other stakeholders to support advanced analytics initiatives and contribute to our overall data strategy. WHERE YOU’LL WORK This position has the flexibility of remote work in the United States. HOW YOU’LL SPEND YOUR TIME - Design and optimize complex data models, schemas, and storage structures across SQL Server, Snowflake, and other platforms to maximize performance, scalability, and data accessibility. - Lead the implementation and continuous improvement of enterprise-wide data warehouse strategies, ensuring data integrity, consistency, and alignment with organizational standards. - Design, develop, and maintain robust, scalable ETL/ELT pipelines leveraging SQL Server, Kafka, Azure Data Factory, Snowflake, and complementary technologies to support high-volume, real-time, and batch data processing. - Partner closely with business intelligence teams, data scientists, analysts, and key stakeholders to gather detailed requirements, translate them into scalable technical solutions, and deliver actionable data assets that drive business outcomes. - Collaborate with the data architecture team to define and implement scalable, high-performance data infrastructure and solutions aligned with enterprise data strategy. - Proactively monitor, troubleshoot, and optimize data pipelines and database systems to ensure high availability, reliability, and minimal latency, swiftly addressing any bottlenecks or failures. - Define, enforce, and champion data governance frameworks, ensuring compliance with data privacy regulations, security policies, and organizational standards. - Drive enhanced data observability by implementing comprehensive monitoring, logging, and alerting mechanisms to enable proactive identification and resolution of data quality and pipeline issues. - Stay abreast of emerging data engineering technologies, tools, and industry best practices to continuously innovate and improve data platform capabilities. - Provide technical leadership and mentorship to junior data engineers, fostering a culture of excellence, knowledge sharing, and adherence to best practices in data engineering and management. WHAT YOU'LL NEED - High school diploma or GED required. Bachelor’s degree in computer science, software engineering, information technology, or a related field or relevant work experience preferred - 6+ years of experience in a data engineering role with a strong focus on data warehousing and ETL processes - Skilled in SQL Server, MySQL, and Snowflake. Design data models, write SQL queries, and optimize database performance. - Experienced in building ETL pipelines using Azure Data Factory, SSIS, and Kafka for data integration and transformation. - Strong background in real-time data processing with Kafka and streaming technologies. - Knowledgeable in data warehouse design, data modeling, and database best practices. - Proficient in Python and Java for scripting and automating data workflows. - Hands-on experience with Azure Cloud Services like Azure Data Factory, Azure Databricks, and Azure SQL Database. Deploy and manage scalable data solutions on Azure. - Familiar with cloud infrastructure, automation, and security best practices to ensure reliable and secure data systems. - Understand data governance, data security, and compliance standards such as GDPR and HIPAA. - Strong problem-solving skills to quickly identify and fix data engineering issues. - Good communication skills to explain technical details clearly to both technical teams and business users. - Experience with RESTful APIs for integrating data systems. - Comfortable with additional programming languages like Scala and advanced Python. - Familiar with data visualization and BI tools to help deliver clear insights. BENEFITS - Flexible and generous paid time off - Competitive medical, dental, vision and life insurance - 401(k) employer matching program - Parental leave - Wellness resources - Charitable matching program - On-site workout facilities (Leawood, Gilbert, Burlington) - Community outreach groups - Tuition reimbursement Fostering A Sense of Belonging Our values-driven culture unifies our teams and inspires a mindset of action, innovation, and collaboration, with a relentless focus on customers. We seek out and celebrate all people and perspectives and cultivate an inclusive culture where everyone can thrive, feel valued, and be authentic. Our culture is firmly rooted in the belief that by embracing our differences and drawing on diverse perspectives, we are a stronger, more innovative, and more successful organization where employees experience a sense of belonging.  Ascend Learning, LLC is proud to be an equal opportunity employer (M/F/Vets/Disabled). No agency or search firm submissions will be accepted. Applications for U.S.-based positions with Ascend Learning, LLC must be legally authorized to work in the United States, and verification of employment eligibility will be required at the time of hire.

United States
MaineGeneral Health System logo

Oncology Data Specialist - Per Diem

MaineGeneral Health System

Helping employees develop their skills and grow their careers is critical to retaining talent and sustaining business. Offers a variety of leadership-supported programs and learning and development resources. Employees are considered the most valuable resource for business growth and community care. Equal Opportunity Employer M/F/Vet/Disability. Assistive technologies and application assistance available for those requesting reasonable accommodation.

Data Engineer47 days ago
Full TimeRemoteTeam 501-1,000

Job Description Summary: Collects, manages, analyzes, and reports on cancer/tumor incidence data. Job Description: Identifies and analyzes the history, diagnosis, treatment, disease status and survival data of cancer patients treated in the organization. Prepares statistical reports on mortality rates, treatment effects, incidence rates of various diagnostic categories and demographic variables. Prepares documentation, abstracts medical records and develops criteria for patient care evaluation, collecting data for protocol studies, and conducting audits for committees and conferences. Assist departments in quality audits and reporting as needed. Complies with all reporting requests and requirements, including requests by the NCDB, quarterly reports to the State Cancer Registry and the annual ACoS report. Serves as a resource to others regarding department policies, procedures and services. Scheduled Weekly Hours: 0 Work Shift: Variable (United States of America) Job Exempt: No Benefits: Supporting all aspects of our employees’ wellness – physical, emotional and financial – is a critical component of being a great place to work. With the wide range of benefits and programs available, employees have the resources they need to be well at every stage of life and plan for the future. Physical Wellness: We offer wellness programs and resources to provide employees access to resources for a healthy lifestyle. Emotional Wellness: When life gets challenging, employees have access to our Employee Assistance Program for employees and anyone in their household. Financial Wellness: - Access the wages you’ve already earned before payday with Payactiv, giving you greater flexibility over your finances. - We offer eligible employees up to 2% of eligible pay in 403(b) company-matching contributions plus another 2% in the 401(a) retirement income plan. Career Mobility: Helping our employees develop their skills and grow their careers is critical to how we retain our talent and sustain our business. We do this by offering our teammates a variety of leadership-supported programs and learning and development resources for every stage of their professional development. We know that our employees are our most valuable resource – they’re how we grow our business and care for our community. Equal Opportunity Employer M/F/Vet/Disability Assistive technologies are available. Application assistance for those requesting reasonable accommodation to the career site is available by contacting HR at (207) 861-3440 .

United States