Emory University logo
Emory University

Located in Atlanta, Georgia, Emory University is one of the world’s leading research universities. A top-ranked, private institution dedicated to serving huma

Data Engineer II

Location

United States

Posted

4 days ago

Salary

0

Seniority

Senior

Bachelor Degree3 yrs expEnglishAirflowApacheAzureETLPySparkPythonSparkSQL

Job Description

Data Engineer II

Emory University

• Collaborate as a core member of cross-functional teams including Business Analysts, Project Managers, Data Analysts, and Architects to deliver high-quality solutions within scope and timeline. • Work directly with researchers and stakeholders to gather, analyze, and translate requirements into technical solutions. • Design, develop, and maintain scalable data pipelines, ETL/ELT processes, and data integration workflows across multiple systems. • Build and optimize data solutions that integrate data from disparate sources, ensuring data quality, integrity, and consistency. • Evaluate emerging technologies and develop proof-of-concepts to support innovation and continuous improvement. • Apply biomedical informatics standards, methodologies, and principles to research data solutions. • Ensure adherence to HIPAA and institutional data governance policies and standards. • Develop and maintain metadata, data standards, and data governance processes for complex datasets. • Create and maintain clear technical documentation, including data pipelines, workflows, and system designs. • Communicate technical concepts effectively to both technical and non-technical stakeholders. • Partner with data and system architects and demonstrate an understanding of data modeling concepts and best practices. • Manage workload effectively and provide timely updates on task progress and deliverables. • Works as a positive team member of a project that may consist of Business Analysts, Project Managers, Information Architects, Data Analysts, and/or Database Administrators to deliver quality applications and components within scope, on time, and within budget. • Manages workload effectively and report status of tasks in a timely manner. • Works directly with researchers to document, analyze, and translate their needs into technical designs and informatics solutions. • Participates in the evaluation of emerging technologies and develops proof-of-concepts. • Contributes to technical teams. • Follows standard operational procedures and HIPAA regulations. • Develops strategies for managing complex data sets through maintaining data standards and metadata. • Applies biomedical informatics technical standards, methodologies, and principles to research-specific program needs, objectives, and outcomes. • Develops complex reports, data pipelines, and ETL processes from disparate systems and ensures their accuracy. • Gathers user requirements and creates technical documentation. • Performs other related duties as required.

Job Requirements

  • A bachelor's degree in a related field and three years of related experience, OR an equivalent combination of education, training, and experience.
  • Strong experience designing and maintaining data pipelines and ETL/ELT processes
  • Proficiency in Python, SQL, and Apache Spark (PySpark)
  • Experience with modern data platforms such as Azure Fabric (preferred), Azure Synapse Serverless, or Databricks
  • Ability to work with large, complex, and distributed datasets
  • Solid understanding of data modeling concepts and best practices
  • Familiarity with data governance, metadata management, and data quality frameworks
  • Knowledge of HIPAA and healthcare data compliance standards
  • Experience with CI/CD practices and proficiency with version control systems like Git
  • Familiarity with data pipeline orchestration and monitoring tools Like Airflow, Azure Data Factory or similar frameworks
  • Understanding of biomedical informatics methodologies is a plus
  • Strong analytical, problem-solving, and critical-thinking abilities
  • Excellent communication and collaboration skills across diverse teams
  • Ability to adapt quickly to new technologies and evolving data environments
  • Exposure to FHIR, OMOP, or similar healthcare data models (nice-to-have)

Benefits

  • Full Remote – Monthly Health and Safety Information Not Applicable

Related Categories

Related Job Pages

More Data Engineer Jobs

Looqbox logo

Data Tech Lead

Looqbox

IA para a Força de Vendas e Operações

Data Engineer4 days ago
Full TimeRemoteTeam 51-200Since 2014H1B No Sponsor

Role Description O Looqbox é uma ferramenta de inteligência artificial que transforma os dados das empresas em ação. Buscamos um(a) Tech Lead de Dados para atuar na conexão entre as necessidades dos clientes e as entregas técnicas do time, contribuindo com visão de negócio, priorização e apoio ao time de dados. - Avaliar e priorizar demandas junto ao time de Analistas de Dados, considerando complexidade, esforço e impacto para o negócio. - Apoiar a comunicação entre PMs e time de dados, garantindo clareza sobre prazos, escopo e viabilidade técnica. - Orientar e dar suporte técnico ao time de Analistas de Dados, contribuindo para o desenvolvimento de dashboards, análises e camadas de dados no Looqbox. - Realizar 1:1 periódicos com os Analistas de Dados, acompanhando desenvolvimento técnico e desempenho. - Atuar em conjunto com os times de Analistas de Dados e PMs no dia a dia, sendo a referência técnica sênior do time de dados. - Garantir que os objetivos e necessidades dos clientes sejam corretamente traduzidos em métricas, KPIs e requisitos de dados pelo time. - Orientar e revisar análises exploratórias e ad hoc de maior complexidade (coortes, funil, segmentações, variações de desempenho, root cause), atuando diretamente nos casos mais críticos. - Definir diretrizes e garantir consistência da camada semântica de métricas (definições, regras de negócio, dimensões) e da documentação do time. - Estabelecer e revisar padrões de data viz e qualidade das entregas do time. Qualifications - Experiência sólida em Python (pandas, numpy, notebooks) e SQL. - Experiência prévia gerenciando ou liderando pessoas/times. - Capacidade de avaliar prioridade e complexidade técnica de demandas, e negociar prazos e expectativas. - Boa comunicação verbal e escrita, com facilidade para transitar entre linguagem técnica e de negócio. - Estatística descritiva e noções de inferência. - Boas práticas de programação: versionamento (Git), documentação, refatoração. - Inglês intermediário. Requirements - Experiência com ferramentas de IA aplicadas a dados. - Experiência no setor varejista. - Experiência com clientes de médio e grande porte. - Modelagem dimensional e construção de camadas semânticas para analytics. - Ferramentas de orquestração/ETL (Airflow) e bases não relacionais. Benefits - R$ 1.100,00 de VR/VA flexíveis no cartão Caju, com uso também em Mobilidade, Cultura, Saúde e Educação. - Plano de Saúde SulAmérica 100% custeado pelo Looqbox, sem coparticipação. - Plano Odontológico MetLife 100% custeado pelo Looqbox, sem coparticipação. - Wellhub (Gympass) para cuidar do seu bem-estar físico e mental. - Incentivo à leitura e educação. Company Description Contratação: Prestador de Serviços (PJ) 100% Home Office

Brazil
UJET logo

Full Stack Engineer, Data-Focused

UJET

Enabling the development of electric vehicles of the future. From #materialscience to ultimate #emobility products.

Data Engineer5 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

• Build and maintain full-stack product features that use data and AI to improve customer, agent, supervisor, and administrator experiences • Develop backend services, APIs, workflows, and integrations that connect product systems with data and AI capabilities • Work with customer interaction data, conversation data, analytics models, and operational datasets to support AI-powered features • Partner with AI, Data Platform, Product, QA, and other engineering teams to design and deliver reliable customer-facing systems • Contribute to data pipelines, data models, and internal tools that make product and operational data easier to use • Build user-facing experiences and internal interfaces using modern JavaScript/TypeScript when needed • Write maintainable, well-tested code and participate in design reviews, code reviews, debugging, and production support • Take ownership of ambiguous problems, break them down clearly, and drive them through delivery • Learn new parts of the stack as needed and help raise the engineering quality bar for the team

Maine
$115K - $130K / year
Welltower™ Inc. (NYSE:WELL) logo

Data Science Intern

Welltower™ Inc. (NYSE:WELL)

Welltower™ is driving the evolution of health care infrastructure so an aging population can live well.

Data Engineer5 days ago
Part TimeRemoteTeam 501-1,000Since 1970H1B No Sponsor

Role Description Welltower’s Data Science Intern is someone who is passionate about turning data into insights. This intern will work alongside the Data Science and Business Insights teams to support the development of analytics solutions, integrate information from various sources, and help evaluate data-driven opportunities across the business. The role will also provide exposure to AI-enabled processes and advanced analytics initiatives that support strategic decision-making. The Data Science Intern will contribute to projects involving: - Data preparation - Exploratory analysis - Predictive modeling - Business intelligence This internship offers an opportunity to gain hands-on experience applying data science techniques within a dynamic real estate and healthcare environment. Qualifications - Currently pursuing a PhD degree in Data Science, Statistics, Mathematics, Economics, Computer Science, Engineering, Information Systems, or a related field. - Demonstrated interest in data science, analytics, machine learning, or artificial intelligence through coursework, projects, research, or prior internships. - Familiarity with data analysis and statistical concepts. - Exposure to programming languages and data science tools such as Python, R, SQL, or similar technologies. - Familiarity with data visualization tools such as Tableau, Power BI, or similar platforms is preferred. - Basic understanding of machine learning concepts and predictive analytics techniques. - Strong analytical and problem-solving skills. - Excellent verbal and written communication skills. - Ability to work independently and collaboratively in a team environment. - Interest in real estate, healthcare, finance, or related industries is a plus. - Coursework in statistics, machine learning, data analytics, predictive modeling, or related disciplines is preferred. Requirements - Employment is contingent upon the successful completion of a background check, drug screening, and verification of employment, education, and other credentials relevant to the position. Company Description Welltower® Inc. (NYSE: WELL) is the world's preeminent residential wellness and healthcare infrastructure company. Our portfolio of 1,500+ Seniors and Wellness Housing communities is positioned at the intersection of housing, healthcare, and hospitality, creating vibrant communities for mature renters and older adults in the United States, United Kingdom, and Canada. We also seek to support physicians in our Outpatient Medical buildings with the critical infrastructure needed to deliver quality care. Our real estate portfolio is unmatched, located in highly attractive micro-markets with stunning built environments. Yet, we are an unusual real estate organization as we view ourselves as a product company in a real estate wrapper driven by relationships and unconventional culture. Through our disciplined approach to capital allocation powered by our data science platform and superior operating results driven by the Welltower Business System, we aspire to deliver long-term compounding of per share growth and returns for our existing investors – our North Star. Welltower is committed to leveraging the talent of a diverse workforce to create great opportunities for our business and our people. EOE/AA. Minority/Female/Sexual Orientation/Gender Identity/Disability/Vet

United States
Job Closed
3Cloud logo

Senior Architect - Data Architecture & Engineering

3Cloud

Delivering the ultimate Microsoft Azure experience.

Data Engineer5 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor

Role Description Are you looking for a role that motivates and challenges you? Are you ready for an opportunity for growth? Do you want to work on teams where people roll up their sleeves to take on tough problems together, and regularly blow the doors off our clients with their outstanding teamwork? If you answered yes to those questions, 3Cloud might just be for you! The Senior Architect in Delivery leads architecture and technical direction for multi-team Azure programs across applications, platforms, and data. You connect client goals to scalable designs, guide delivery across teams, and shape modernization work so it delivers measurable results. At this level, you influence architecture beyond a single project. You set direction across engagements, work with business and technology leaders, raise the bar on delivery quality, and promote reusable patterns. You mentor architects and senior engineers, support strategic pursuits, and turn working solutions into repeatable delivery models. Responsibilities - Solution Architecture and Technical Leadership - Lead architecture and technical strategy for Azure modernization and transformation programs that span multiple teams and workstreams. - Translate client goals into scalable designs that align with business priorities, non-functional requirements, delivery constraints, and program-level outcomes. - Drive architecture across teams so designs follow shared models, standards, and patterns. - Collaborate with architects and engineers in other domains to integrate solutions and maintain a cohesive end-to-end architecture. - Provide ongoing architectural guidance during implementation, including reviews of key designs and code, and define patterns and guardrails that teams can reuse. - Apply solid engineering practices in your primary domain—modular design, clear interfaces, testability, and observability—so solutions remain robust and maintainable. - Use AI-assisted tooling to accelerate design, code, tests, documentation, and analysis, and help teams adopt effective practices at program scale. - Delivery and Consulting Excellence - Lead or co-lead discovery and roadmap work for programs or large workstreams, turning inputs into integrated, testable backlogs with clear non-functional requirements and dependencies. - Use structured problem solving to clarify scope, dependencies, and risks at program scale, and explain options in terms of value, cost, risk, and time-to-impact. - Communicate architecture strategy and decisions clearly to technical and non-technical audiences, including executives. - Build trusted relationships with product, engineering, and technology leaders, and help shape modernization roadmaps in the client’s best interest. - Provide architecture oversight so designs, interfaces, and integration points support predictable delivery and stable team velocity. - Align multiple teams on shared outcomes, contracts, and integration points, ensuring dependencies are identified, owned, and tracked through to delivery. - Help define delivery approaches, working agreements, and documentation practices that keep 3Cloud and client teams aligned across locations and time zones. - Support effective use of Agile at scale by ensuring architecture and backlog structure enable incremental delivery, clear definitions of done, and data-informed adjustments based on telemetry and feedback. - Apply a consulting mindset by anticipating client needs, proposing options, and tying solutions to clear results and adoption, and handle challenge and pushback by explaining trade-offs in simple, direct language. - Mentorship and Team Development - Mentor architects, senior engineers, and technical leads, building their design skills, architectural judgment, and ability to work effectively across systems and teams. - Provide architectural oversight across teams or workstreams, modeling pragmatic decision-making and showing when to keep solutions simple and when new patterns or technologies are justified. - Support hiring and growth by participating in technical interviews, calibration discussions, and mentorship, and by helping shape development plans for future architects. - Growth and Innovation - Contribute to business development by identifying opportunities beyond the current assignment across all our capabilities and assisting the sales director in pursuing them. - Intentionally build relationship networks within client accounts to deepen partnership and identify opportunities to provide additional business value. - Partner with sales and account leaders on strategic pursuits by setting the technical vision, contributing to solution strategy, and participating in client workshops, demos, and roadmap sessions. - Create solution options, high-level designs, and estimates for programs, clearly documenting assumptions, dependencies, and risks and tying them back to business value and risk reduction. - Build and evolve reusable assets—such as reference architectures, runbooks, workshops, starter repositories, and templates—that become standard paths for delivery teams. - Champion adoption of modern frameworks, patterns, platform capabilities, automation, and AI-assisted tools that improve quality, speed, or reliability in a safe and secure way. - Actively participate in enablement initiatives, share lessons from complex engagements, and help build a culture of collaboration, continuous improvement, and knowledge sharing. Qualifications - 10+ years of experience delivering solutions in a primary technical domain. - 5+ years of experience in solution architecture and leading development or engineering teams, including multi-team or multi-workstream efforts. - 8+ years of experience in data engineering, including 4+ years of experience architecting data solutions on Azure. - Deep expertise in Microsoft Azure with experience with Databricks and/or Fabric. - Proven ability to design and implement modern data architectures (data lakes, data warehouses, lakehouses, data mesh, streaming pipelines). - Proficiency in Python, PySpark, SQL, and data engineering frameworks. - Azure DevOps (including building Stories and tasks, and using pipelines and ARM templates for publishing code). - Knowledge of infrastructure as code, APIs, security, compliance, and master data management. - Experience optimizing data pipelines, queries, and architectures for performance and cost. - Proven experience leading architecture and delivery for Azure-based solutions such as modernizations, transformations, or platform build-outs. - Ability to define solution architectures that connect business goals to scalable technical designs and solid delivery practices. - Experience leading hybrid and remote teams and maintaining alignment, quality, and predictable delivery across time zones. - Deep knowledge of core concepts, languages, frameworks, and design patterns in your primary domain, with the ability to apply them at program scale. - Experience using AI-augmented development and integrating AI or machine learning capabilities into solutions using APIs, frameworks, or cloud-based AI services. - Experience with Agile or Scrum at scale, including backlog management, work slicing, and dependency handling. - Experience in consulting or professional services. - Familiarity with key Azure services relevant to your domain, such as messaging, compute, data, security, networking, and integration. - Strong analytical and problem-solving skills, with clear written and verbal communication. - Demonstrated interest in learning new cloud technologies and turning that learning into practical improvements for teams. - Ability to stay hands-on with architecture and, when needed, implementation while guiding complex cloud solutions across teams. Requirements - At this time, we cannot sponsor applicants for work visas. Benefits - Flexible work location with a virtual first approach to work! - 401(K) with match up to 50% of your 6% contributions of eligible pay. - Generous PTO providing a minimum of 15 days in addition to 9 paid company holidays and 2 floating personal days. - Two medical plan options to allow you the choice to elect what works best for you! - Option for vision and dental coverage. - 100% employer paid coverage for life and disability insurance. - Paid leave for birth parents and non-birth parents. - Option for Healthcare FSA, HSA, and Dependent Care FSA. - $67.00 monthly tech and home office allowance. - Utilization and/or discretionary bonus eligibility based on role. - Employee Assistance Program to help with everyday challenges. - 3Cloud offers competitive compensation. In addition to base pay employees are eligible to receive an annual discretionary/utilization bonus. - Base Salary Range: $136,300 — $204,500 USD.

United States
$136.3K - $204.5K / year