Job Closed
This listing is no longer active.
Headquartered in Rochester, Minnesota, Mayo Clinic is a nonprofit medical institution ranked first in more specialties than all other hospitals in America. The company employs arou
Senior Data Engineer
Location
United States
Posted
94 days ago
Salary
$138K - $200K / year
Seniority
Senior
No structured requirement data.
Job Description
Senior Data Engineer
Mayo Clinic
We are seeking a talented Senior Data Engineer to join our Advanced Data Lake (ADL) team. This is an infrastructure-heavy, hybrid cloud role with Google Cloud Platform (GCP) as a core requirement. You will build and operate enterprise data Lakehouse platforms that support large-scale analytics and digital transformation. Your responsibilities will include architecting and maintaining automated data pipelines for ingesting, transforming, and integrating complex datasets. You will use DataStream for real-time data movement and Dataflow for processing at scale. Composer/Airflow will be leveraged for seamless scheduling, monitoring, and automation of pipeline operations. Infrastructure provisioning and workflow management will be handled with Terraform and Dataform to ensure reproducibility and adherence to best practices. All code and pipeline assets will be managed through git repositories, with CI/CD automation and streamlined releases enabled by Azure DevOps (ADO). Changes will be governed by ServiceNow processes to ensure traceability, auditability, and operational compliance. Core duties involve working with cross-functional teams to translate business needs into pipeline specifications, building and optimizing data models for advanced analytics, and maintaining data quality and security throughout all processes. You will automate workflow monitoring and proactively resolve data issues, applying strong technical and problem-solving skills. The ideal candidate will have proficiency in Python and SQL, with significant experience in Google Cloud Platform (especially Dataflow and DataStream), Terraform, Dataform, and orchestration with Composer/Airflow. Experience managing code in git repositories, working with Azure DevOps workflows, and following ServiceNow change management processes is required. Strong communication skills and the ability to manage multiple priorities in a remote, team-oriented environment are also necessary. Develops and deploys data pipelines, integrations and transformations to support analytics and machine learning applications and solutions as part of an assigned product team using various open-source programming languages and vended software to meet the desired design functionality for products and programs. The position requires maintaining an understanding of the organization's current solutions, coding languages, tools, and regularly requires the application of independent judgment. May provide consultative services to departments/divisions and leadership committees. Demonstrated experience in designing, building, and installing data systems and how they are applied to the Department of Data & Analytics technology framework is required. Candidate will partner with product owners and Analytics and Machine Learning delivery teams to identify and retrieve data, conduct exploratory analysis, pipeline and transform data to help identify and visualize trends, build and validate analytical models, and translate qualitative and quantitative assessments into actionable insights. This is a full time remote position within the United States. Mayo Clinic will not sponsor or transfer visas for this position including F1 OPT STEM> Why Mayo Clinic Mayo Clinic is top-ranked in more specialties than any other care provider according to U.S. News & World Report. As we work together to put the needs of the patient first, we are also dedicated to our employees, investing in competitive compensation and comprehensive benefit plans – to take care of you and your family, now and in the future. And with continuing education and advancement opportunities at every turn, you can build a long, successful career with Mayo Clinic. Benefits Highlights - Medical: Multiple plan options. - Dental: Delta Dental or reimbursement account for flexible coverage. - Vision: Affordable plan with national network. - Pre-Tax Savings: HSA and FSAs for eligible expenses. - Retirement: Competitive retirement package to secure your future. Just as our reputation has spread beyond our Minnesota roots, so have our locations. Today, our employees are located at our three major campuses in Phoenix/Scottsdale, Arizona, Jacksonville, Florida, Rochester, Minnesota, and at Mayo Clinic Health System campuses throughout Midwestern communities, and at our international locations. Each Mayo Clinic location is a special place where our employees thrive in both their work and personal lives. Learn more about what each unique Mayo Clinic campus has to offer, and where your best fit is. Equal Opportunity All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, protected veteran status or disability status. Learn more about the "EOE is the Law". Mayo Clinic participates in E-Verify and may provide the Social Security Administration and, if necessary, the Department of Homeland Security with information from each new employee's Form I-9 to confirm work authorization.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Microsoft Fabric Specialist / Data Warehouse Engineer
Apex CompaniesApex Companies is a nationally recognized environmental consulting and engineering firm committed to creating a safe, sustainable, and equitable future. Since its founding in 1988,
Are you highly motivated, hard-working, and seeking to join a growth-focused consulting & engineering firm? Are you looking for a company that will invest in your development and grow your professional skills? If so, consider a career with Apex! Powered by record sales, extraordinary client retention, strategic acquisitions, and an entrepreneurial spirit, Apex Companies is one of the fastest growing engineering and environmental consulting firms in the US. We were recently recognized by the Zweig Group as one of the fastest growing firms in the AEC industry. We take pride in providing our clients with exceptional service and have earned numerous awards for project excellence. We continue to grow, and we want you to grow with us. We are seeking a highly skilled Microsoft Fabric Specialist to join our data and analytics team. This role will focus on designing, implementing, and optimizing solutions within Microsoft Fabric, enabling seamless integration of data across the enterprise. You will play a key role in building scalable data pipelines, managing lakehouses, and leveraging Fabric’s unified analytics capabilities to deliver actionable insights. Your Responsibilities as a Microsoft Fabric Specialist / Data Warehouse Engineer: - Architect and implement Microsoft Fabric solutions for data integration, analytics, and governance. - Develop and maintain lakehouses, dataflows, and pipelines within Fabric. - Collaborate with business stakeholders to understand requirements and translate them into robust data models. - Optimize performance and ensure data security and compliance within the Fabric environment. - Stay current with Microsoft Fabric updates and best practices to drive innovation. What we're looking for: - Proven experience with Microsoft Fabric and related technologies (Data Factory, Synapse, Power BI). - Strongly preferred direct experience in the Civil or Environmental Engineering, or Construction industries - Direct experience required working with financial and accounting databases - Strong understanding of data architecture, ETL processes, and cloud-based analytics. - Proficiency in SQL, DAX, and data modeling. - Familiarity with Azure Data Services and governance frameworks. - Excellent problem-solving and communication skills. Preferred Skills - Experience with data lakehouse architecture and OneLake. - Knowledge of data security, compliance, and governance in cloud environments. - Background in business intelligence and data visualization. Why you'll love working for us: - Company-subsidized medical and dental. - Company-paid life, short, and long-term disability. - 401k match, tuition assistance, and more. - Cross-training and the ability to work on a variety of projects. - Performance-based bonuses or other incentives. - Working with the best and brightest in the industry. - 2,000+ employee national firm with 50+ locations across the US. Apex Job Title: Data Engineer 3 Req ID: 11274 Annual Expected Pay Range $80,000—$120,000 USD We believe in equality for all and celebrate the diversity and differences of our employees, customers, and communities. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Apex aims to make apexcos.com accessible to all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, please contact Talent@apexcos.com or (301) 417-0200. Likewise, feel free to reach out to us if you would like to view or discuss Apex policy related to equal employment opportunity or have any related concerns. EO/AA/VEV/Disabled Employer TO ALL RECRUITMENT AGENCIES: Apex Companies does not accept unsolicited agency resumes. Please do not forward resumes for any of our job postings to our career’s sites, or to any employees of Apex Companies or affiliates. Apex Companies is not responsible for any fees related to unsolicited resumes.
Data Engineer (New grads welcome to apply / Considering only U.S. citizens and green card holders at this time.)
ATPCOATPCO is committed to providing the best flight shopping experiences through reliable pricing data and innovative retail technology. Positioning itself as "the foundation of modern
Company Description ATPCO is the world's primary source for air fare content, holding over 200 million fares across 160 countries. Every day, the travel industry relies on ATPCO's technology and data solutions to help millions of travelers reach their destinations efficiently. Join us and contribute to the development of innovative applications that power global travel. ATPCO is everywhere people buy flights. We’re not just shaping the future of air travel– we’re redefining how and where great work happens. At ATPCO, we believe in flexibility, trust, and a culture where your wellbeing comes first Why Join Us? ✅ Remote-First Culture – Flexibility to work from home in your country of hire ✅ “Leave Your Way” PTO– Take the time you need, when you need it ✅ 401(k) with Generous Employer Match– Invest in your future ✅ Comprehensive Benefits– Medical, dental, vision, & mental health ✅ Global Tuition and Gym Reimbursement– Learn and grow on us ✅ Standby Flight Program– Explore the world ✅ Inclusive, Collaborative Culture– Be seen, heard, and valued Our Culture: We’ve built a remote-first culture rooted in trust, transparency, and belonging. With open-door leadership, weekly 1:1s, and real-time recognition, we keep our people connected and valued—no matter where they work. Our cultural pillars of Collaboration, Empowerment, Innovation, Learning, Transparency, and Trust guide how we show up for one another and grow together. Job Description As a Data Engineer, you will be responsible for building and optimizing data pipelines, managing data storage and processing systems, and ensuring the availability, scalability, and reliability of our data platform. You will collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders to understand data requirements and deliver efficient high-quality data solutions. We are seeking an accomplished individual to join our esteemed team of ATPCO data engineers, dedicated to tackling intricate data processing challenges within the Airline industry. This role offers an opportunity to work on cutting-edge solutions that involve handling hundreds of terabytes of data daily, leveraging the latest AWS services. You Will: · Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design data models and schemas that facilitate data analysis and reporting · Design, develop, and maintain scalable and efficient data pipelines and ETL processes to ingest, process, and transform large volumes of data from various sources into usable formats · Build and optimize data storage and processing systems, including data warehouses, data lakes, and big data platforms, using AWS services such as Amazon Redshift, AWS Glue, AWS EMR, AWS S3, and AWS Lambda, to enable efficient data retrieval and analysis · Implement and manage real-time data streaming architectures using AWS services like Amazon Kinesis or Apache Kafka to enable real-time data processing and analytics · Perform data profiling, data cleansing, and data transformation tasks to prepare data for analysis and reporting · Implement data security and privacy measures to protect sensitive and confidential data using AWS security services and features · Design and implement data architectures following Data Mesh principles within the AWS environment, including domain-oriented data ownership, self-serve data infrastructure, and federated data governance · Provide technical guidance and mentorship to junior data engineers, reviewing their work and ensuring adherence to best practices and standards Qualifications: · Strong programming skills in languages like Python, Java, or Scala, with experience in data manipulation and transformation frameworks · Proven experience as a data engineer, with experience in designing and building large-scale data processing systems · Strong understanding of data modeling concepts and data management principles · In-depth knowledge of SQL and experience working with relational and non-relational databases · Knowledge of Data Mesh principles and experience designing and implementing data architectures following Data Mesh concepts within the AWS ecosystem · Experience with real-time data streaming architectures using AWS services like Amazon Kinesis or Apache Kafka · Familiarity with AWS cloud services, such as AWS Glue, AWS Lambda, AWS EMR, AWS S3, Amazon Redshift, and their data-related features and functionalities · Familiarity with AWS security services and features for data security and privacy · Bachelor's or Master's degree in Computer Science, Information Systems, or a related field Salary Range: $92,686 – $125,000 Unfortunately, at this time we are only able to consider U.S. citizens and green card holders. *The disclosed range estimate has not been adjusted for applicable geographic differential associated with the United States* Additional Information At ATPCO, we are deeply committed to diversity, equity, and inclusion. Our supportive policies promote work-life balance through flexible work arrangements, and we cultivate a workplace where every employee feels valued, respected, and a true sense of belonging. We consider qualified applicants for employment without regard to race, gender, age, color, religion, national origin, citizenship status, marital status, disability, sexual orientation, protected military/veteran status, gender identity or expression, genetic information, marital status, medical condition, or any other legally protected factor All your information will be kept confidential according to EEO guidelines.
• Build secure, repeatable data ingestion and transformation pipelines. • Implement data cleansing rules and produce auditable, reproducible outputs. • Establish Import/export patterns, handling data extracts, schema discovery, incremental loads, handling multiple source instances. • Strong ability to interpret and apply geographical context in data processing pipelines.
Microsoft Fabric Specialist, Data Warehouse Engineer
Apex CompaniesApex Companies is a nationally recognized environmental consulting and engineering firm committed to creating a safe, sustainable, and equitable future. Since i
• Architect and implement Microsoft Fabric solutions for data integration, analytics, and governance. • Develop and maintain lakehouses, dataflows, and pipelines within Fabric. • Collaborate with business stakeholders to understand requirements and translate them into robust data models. • Optimize performance and ensure data security and compliance within the Fabric environment. • Stay current with Microsoft Fabric updates and best practices to drive innovation.

