Texas State Library and Archives Commision

Proficiency with creating CI/CD pipelines and stages with Harness using YAML templates. Kong plugin development using Lua or Go. Experience with Package Managers like LuaRocks. Experience with containerization (Docker), and orchestration tools (Kubernetes). Experience with cloud platforms such as AWS, Google Cloud, or Azure. Familiarity with monitoring and logging tools like Datadog and OpenTelemetry.

Data Engineer

Location

United States

Posted

4 days ago

Salary

0

Seniority

Mid Level

Job Description

Data Engineer

Texas State Library and Archives Commision

Role Description We are seeking a skilled Data Engineer with AWS experience to design and develop ETL jobs for a DB2 data warehouse to support Cognos reporting needs. The ideal candidate will work closely with business intelligence teams to ensure efficient data extraction, transformation, and loading processes while optimizing database performance. This role requires strong expertise in DB2, AWS, and ETL development. - Design, develop, and maintain ETL jobs to ingest, transform, and load data into the DB2 data warehouse for Cognos reporting. - Utilize AWS services (S3, EC2, RDS, Step Functions, etc.) to optimize data processing workflows. - Implement best practices for data modeling to ensure efficient reporting in IBM Cognos Analytics. - Work with business and reporting teams to gather data transformation requirements and build pipelines accordingly. - Develop and optimize SQL queries, stored procedures, and indexing strategies for DB2. - Ensure data integrity, quality, and performance tuning of ETL processes. - Manage large-scale data migration and integration projects between cloud and on-prem DB2 systems. - Automate data workflows using AWS services. - Monitor, troubleshoot, and optimize ETL processes for performance and reliability. - Support Cognos report developers in structuring data efficiently to meet reporting needs. - Implement security, compliance, and data governance best practices for handling sensitive data. Qualifications - 5+ years of experience in ETL development, data engineering, and data warehousing. - Strong hands-on experience with AWS services (S3, RDS, Redshift, etc.). - Expertise in DB2 database development, including SQL, stored procedures, and performance tuning. - Proficiency in Python or Shell scripting for automation. - Experience with IBM Cognos Analytics and understanding of reporting structures. - Strong problem-solving, analytical, and communication skills. - Experience working in Agile and DevOps environments. Requirements - Bachelor's degree in computer science, Information Systems, or a related field. - Experience in Medicaid and/or Healthcare Plan environment is strongly preferred. - Knowledge of DB2 on AWS Cloud. - AWS Certified Data Analytics - Specialty or AWS Certified Solutions Architect is a plus.

Related Categories

Related Job Pages

More Data Engineer Jobs

Emory University logo

Data Engineer II

Emory University

Located in Atlanta, Georgia, Emory University is one of the world’s leading research universities. A top-ranked, private institution dedicated to serving huma

Data Engineer4 days ago

• Collaborate as a core member of cross-functional teams including Business Analysts, Project Managers, Data Analysts, and Architects to deliver high-quality solutions within scope and timeline. • Work directly with researchers and stakeholders to gather, analyze, and translate requirements into technical solutions. • Design, develop, and maintain scalable data pipelines, ETL/ELT processes, and data integration workflows across multiple systems. • Build and optimize data solutions that integrate data from disparate sources, ensuring data quality, integrity, and consistency. • Evaluate emerging technologies and develop proof-of-concepts to support innovation and continuous improvement. • Apply biomedical informatics standards, methodologies, and principles to research data solutions. • Ensure adherence to HIPAA and institutional data governance policies and standards. • Develop and maintain metadata, data standards, and data governance processes for complex datasets. • Create and maintain clear technical documentation, including data pipelines, workflows, and system designs. • Communicate technical concepts effectively to both technical and non-technical stakeholders. • Partner with data and system architects and demonstrate an understanding of data modeling concepts and best practices. • Manage workload effectively and provide timely updates on task progress and deliverables. • Works as a positive team member of a project that may consist of Business Analysts, Project Managers, Information Architects, Data Analysts, and/or Database Administrators to deliver quality applications and components within scope, on time, and within budget. • Manages workload effectively and report status of tasks in a timely manner. • Works directly with researchers to document, analyze, and translate their needs into technical designs and informatics solutions. • Participates in the evaluation of emerging technologies and develops proof-of-concepts. • Contributes to technical teams. • Follows standard operational procedures and HIPAA regulations. • Develops strategies for managing complex data sets through maintaining data standards and metadata. • Applies biomedical informatics technical standards, methodologies, and principles to research-specific program needs, objectives, and outcomes. • Develops complex reports, data pipelines, and ETL processes from disparate systems and ensures their accuracy. • Gathers user requirements and creates technical documentation. • Performs other related duties as required.

United States
Looqbox logo

Data Tech Lead

Looqbox

IA para a Força de Vendas e Operações

Data Engineer4 days ago
Full TimeRemoteTeam 51-200Since 2014H1B No Sponsor

Role Description O Looqbox é uma ferramenta de inteligência artificial que transforma os dados das empresas em ação. Buscamos um(a) Tech Lead de Dados para atuar na conexão entre as necessidades dos clientes e as entregas técnicas do time, contribuindo com visão de negócio, priorização e apoio ao time de dados. - Avaliar e priorizar demandas junto ao time de Analistas de Dados, considerando complexidade, esforço e impacto para o negócio. - Apoiar a comunicação entre PMs e time de dados, garantindo clareza sobre prazos, escopo e viabilidade técnica. - Orientar e dar suporte técnico ao time de Analistas de Dados, contribuindo para o desenvolvimento de dashboards, análises e camadas de dados no Looqbox. - Realizar 1:1 periódicos com os Analistas de Dados, acompanhando desenvolvimento técnico e desempenho. - Atuar em conjunto com os times de Analistas de Dados e PMs no dia a dia, sendo a referência técnica sênior do time de dados. - Garantir que os objetivos e necessidades dos clientes sejam corretamente traduzidos em métricas, KPIs e requisitos de dados pelo time. - Orientar e revisar análises exploratórias e ad hoc de maior complexidade (coortes, funil, segmentações, variações de desempenho, root cause), atuando diretamente nos casos mais críticos. - Definir diretrizes e garantir consistência da camada semântica de métricas (definições, regras de negócio, dimensões) e da documentação do time. - Estabelecer e revisar padrões de data viz e qualidade das entregas do time. Qualifications - Experiência sólida em Python (pandas, numpy, notebooks) e SQL. - Experiência prévia gerenciando ou liderando pessoas/times. - Capacidade de avaliar prioridade e complexidade técnica de demandas, e negociar prazos e expectativas. - Boa comunicação verbal e escrita, com facilidade para transitar entre linguagem técnica e de negócio. - Estatística descritiva e noções de inferência. - Boas práticas de programação: versionamento (Git), documentação, refatoração. - Inglês intermediário. Requirements - Experiência com ferramentas de IA aplicadas a dados. - Experiência no setor varejista. - Experiência com clientes de médio e grande porte. - Modelagem dimensional e construção de camadas semânticas para analytics. - Ferramentas de orquestração/ETL (Airflow) e bases não relacionais. Benefits - R$ 1.100,00 de VR/VA flexíveis no cartão Caju, com uso também em Mobilidade, Cultura, Saúde e Educação. - Plano de Saúde SulAmérica 100% custeado pelo Looqbox, sem coparticipação. - Plano Odontológico MetLife 100% custeado pelo Looqbox, sem coparticipação. - Wellhub (Gympass) para cuidar do seu bem-estar físico e mental. - Incentivo à leitura e educação. Company Description Contratação: Prestador de Serviços (PJ) 100% Home Office

Brazil
UJET logo

Full Stack Engineer, Data-Focused

UJET

Enabling the development of electric vehicles of the future. From #materialscience to ultimate #emobility products.

Data Engineer4 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

• Build and maintain full-stack product features that use data and AI to improve customer, agent, supervisor, and administrator experiences • Develop backend services, APIs, workflows, and integrations that connect product systems with data and AI capabilities • Work with customer interaction data, conversation data, analytics models, and operational datasets to support AI-powered features • Partner with AI, Data Platform, Product, QA, and other engineering teams to design and deliver reliable customer-facing systems • Contribute to data pipelines, data models, and internal tools that make product and operational data easier to use • Build user-facing experiences and internal interfaces using modern JavaScript/TypeScript when needed • Write maintainable, well-tested code and participate in design reviews, code reviews, debugging, and production support • Take ownership of ambiguous problems, break them down clearly, and drive them through delivery • Learn new parts of the stack as needed and help raise the engineering quality bar for the team

Maine
$115K - $130K / year
Welltower™ Inc. (NYSE:WELL) logo

Data Science Intern

Welltower™ Inc. (NYSE:WELL)

Welltower™ is driving the evolution of health care infrastructure so an aging population can live well.

Data Engineer4 days ago
Part TimeRemoteTeam 501-1,000Since 1970H1B No Sponsor

Role Description Welltower’s Data Science Intern is someone who is passionate about turning data into insights. This intern will work alongside the Data Science and Business Insights teams to support the development of analytics solutions, integrate information from various sources, and help evaluate data-driven opportunities across the business. The role will also provide exposure to AI-enabled processes and advanced analytics initiatives that support strategic decision-making. The Data Science Intern will contribute to projects involving: - Data preparation - Exploratory analysis - Predictive modeling - Business intelligence This internship offers an opportunity to gain hands-on experience applying data science techniques within a dynamic real estate and healthcare environment. Qualifications - Currently pursuing a PhD degree in Data Science, Statistics, Mathematics, Economics, Computer Science, Engineering, Information Systems, or a related field. - Demonstrated interest in data science, analytics, machine learning, or artificial intelligence through coursework, projects, research, or prior internships. - Familiarity with data analysis and statistical concepts. - Exposure to programming languages and data science tools such as Python, R, SQL, or similar technologies. - Familiarity with data visualization tools such as Tableau, Power BI, or similar platforms is preferred. - Basic understanding of machine learning concepts and predictive analytics techniques. - Strong analytical and problem-solving skills. - Excellent verbal and written communication skills. - Ability to work independently and collaboratively in a team environment. - Interest in real estate, healthcare, finance, or related industries is a plus. - Coursework in statistics, machine learning, data analytics, predictive modeling, or related disciplines is preferred. Requirements - Employment is contingent upon the successful completion of a background check, drug screening, and verification of employment, education, and other credentials relevant to the position. Company Description Welltower® Inc. (NYSE: WELL) is the world's preeminent residential wellness and healthcare infrastructure company. Our portfolio of 1,500+ Seniors and Wellness Housing communities is positioned at the intersection of housing, healthcare, and hospitality, creating vibrant communities for mature renters and older adults in the United States, United Kingdom, and Canada. We also seek to support physicians in our Outpatient Medical buildings with the critical infrastructure needed to deliver quality care. Our real estate portfolio is unmatched, located in highly attractive micro-markets with stunning built environments. Yet, we are an unusual real estate organization as we view ourselves as a product company in a real estate wrapper driven by relationships and unconventional culture. Through our disciplined approach to capital allocation powered by our data science platform and superior operating results driven by the Welltower Business System, we aspire to deliver long-term compounding of per share growth and returns for our existing investors – our North Star. Welltower is committed to leveraging the talent of a diverse workforce to create great opportunities for our business and our people. EOE/AA. Minority/Female/Sexual Orientation/Gender Identity/Disability/Vet

United States
Job Closed