Data Engineer

Data EngineerData EngineerFull TimeRemoteMid LevelTeam 1,001-5,000H1B SponsorCompany SiteLinkedIn

Location

Texas

Posted

12 days ago

Salary

$100K - $123K / year

Seniority

Mid Level

Job Description

Data Engineer

DTN

• Deliver trusted data sets and services from complex data sources and environments to support DTN customers and internal stakeholders • Support the development and delivery of modern data and analytics architecture through data integration, acquisition, and management solutions • Design, build, and maintain data pipelines and ingestion processes that ensure data quality, reliability, and scalability • Support customer and partner data infrastructure needs by troubleshooting technical issues and optimizing data environments • Contribute to the continuous improvement of data management standards, practices, and architectural patterns • Document data engineering processes, standards, and best practices to promote adoption across teams • Ensure data governance, security, and compliance requirements are incorporated into solution delivery • Identify opportunities to automate processes, reduce complexity, and improve operational efficiency through innovative data solutions • Develop reference architectures, standards, and documentation to support consistent approaches to data acquisition, transformation, storage, and analytics consumption

Job Requirements

  • 2+ years of data engineering experience with pipelines, data ingestion, ETL/ELT processes, or 2+ years of software engineering experience
  • 2+ years of cloud experience, preferably across multiple cloud platforms
  • Strong programming skills in Python or other modern development languages such as Java or Go
  • Experience with ETL processes, SQL development, and data transformation workflows
  • Experience working with relational databases such as Oracle, PostgreSQL, or MySQL
  • Experience with AWS cloud services and cloud-based data platforms such as Snowflake or AWS-native solutions
  • Ability to design solutions that support data transformation, governance, workload management, and complex data structures
  • Experience with cloud architectures, highly available systems, and scalable solutions
  • Familiarity with Agile development methodologies and CI/CD practices
  • Experience with Docker and Kubernetes environments
  • Bachelor’s degree in Computer Science or equivalent experience

Benefits

  • Competitive Salary
  • Unlimited PTO
  • Flexible working hours
  • Remote work model (position dependent)
  • Competitive Medical, Dental and Vision Insurance Plans
  • 6% 401K matching
  • Unlimited access to 13k+ courses via learning platform to support employee career advancement
  • Employee Assistance Program (EAP)

Related Categories

Related Job Pages

More Data Engineer Jobs

ETL Developer

Golden 1 Credit Union

Golden 1 Credit Union is an award-winning credit union and member-owned financial cooperative. Founded in 1933, Golden 1 Credit Union is now the sixth-largest c

Data Engineer12 days ago

IT - Enterprise Data Platform - ETL Developer (Remote in CA only) Location: 8945 Cal Center Dr, Sacramento, CA 95826, USA STATUS: EXEMPT REPORT TO: ENTERPRISE DATA MANAGER DEPARTMENT: IT – INFRASTRUCTURE SYSTEMS PAY RANGE: $102,000.00 - $125,000.00 ANNUALLY GENERAL DESCRIPTION: The ETL Developer / Consultant provides technical expertise in analysis, design, development, rollout and maintenance of data integration implementations. This position is a contributor to the architecture and implementation methodologies and best practices of the data integration competency within the Enterprise Data Management team. The ETL Developer will work on, and may lead, project teams to analyze, design, develop and deploy implementations of enterprise solutions to support a variety of customer needs. TASKS, DUTIES, FUNCTIONS: - Develops, analyzes, implements, configures, tests, debugs and maintains data integration processes to fit project requirements (includes data capture, testing and validation methods) - Functions as a technical resource on projects throughout the project lifecycle - Provides support for application systems and business processes - Diagnoses and remedies technical problems to ensure platform up-time and application service levels are met for the project - Supports, maintains and monitors the health of the processes, inbound and outbound feeds for data integrity - Writes high quality processes utilizing structured development techniques to support process components and development - Utilizes agile-based approach to implementing data services and solutions - Recommend improvements to processes as supported by integration systems - Partner with quality assurance testing teams to identify errors and confirm business specifications have been achieved - Support the transfer of processes from test environment to quality environment to production environment (i.e. for data integration code and related solutions) - Support the development of end-user materials (i.e. Runbook) - Collects information to analyze and evaluate existing or proposed application designs - Convert technical specifications into code using proprietary and/or non-proprietary tools with assistance from more experienced analysts - Maintains system and programming guidelines by adhering to the software development lifecycle; Develops and maintains artifacts of the integration architecture - Assists with the definition and implementation of processes, policies, standards and procedures to ensure compliance with corporate and regulatory policies - Participate in the “on-call” rotation. - Performs other job-related duties as necessary. - Effective oral and written communication skills required to train, direct, and evaluate staff, diagnose, correct and log computer projects and problems. PHYSICAL SKILLS, ABILITIES, AND EXERTION UTILIZED IN THE PERFORMANCE OF THESE TASK: - Prolonged sitting throughout the workday to accomplish tasks. - Availability for emergencies and on call duty 24 hours a day, 7 days a week, as needed. - Occasional travel may be required. - Lift and carry communications equipment and computer hardware weighing up to fifty pounds. - Corrected vision in the normal range required to configure, test, and troubleshoot network server hardware and data. - Hearing within normal range. - Must possess sufficient manual dexterity to skillfully operate applicable computer hardware, a variety of hand tools and standard office equipment. - May work additional work hours to accomplish tasks. ORGANIZATIONAL CONTACTS & RELATIONSHIPS: - INTERNAL: All levels of staff and management - EXTERNAL: Vendors QUALIFICATIONS: - EDUCATION: Bachelor’s degree in Computer Science, Management Information Systems or comparable discipline or equivalent work experience. - EXPERIENCE: - Minimum three to five years’ experience developing, deploying and supporting enterprise integration technologies for On-Premises and Cloud solutions. - 3-5 years consulting experience preferred. - Experience in enterprise architecture, security, management and monitoring. - Data Integration experience necessary. - Experience with Data Bricks, SSIS, BI visualization tools and enterprise schedulers desired. - KNOWLEDGE / SKILLS: - Strong understanding of data management best practices and concepts - Strong SQL skills expected PHYSICAL REQUIREMENTS: - Minimum three to five years’ experience developing, deploying and supporting enterprise integration technologies for On-Premises and Cloud solutions - 3-5 years consulting experience preferred - Experience in enterprise architecture, security, management and monitoring - Strong understanding of data management best practices and concepts - Strong SQL skills expected - Data Integration experience necessary - Experience with Data Bricks, SSIS, BI visualization tools and enterprise schedulers desired LICENSES / CERTIFICATIONS: N/A Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. THIS JOB DESCRIPTION PROVIDES AN OVERVIEW OF THE GENERAL SCOPE AND LEVEL OF WORK EXPECTED TO BE PERFORMED, BUT IT IS NOT AN EXHAUSTIVE LIST OF ALL DUTIES OR RESPONSIBILITIES ASSOCIATED WITH THE POSITION. THE CREDIT UNION RESERVES THE RIGHT TO MODIFY, ADD, OR REMOVE DUTIES AS NEEDED WITHOUT ADVANCE NOTICE. EMPLOYEES MAY BE REQUIRED TO PERFORM ADDITIONAL TASKS AND DUTIES AS DIRECTED BY THEIR SUPERVISOR, PROVIDED SUCH TASKS ARE WITHIN THE EMPLOYEE’S KNOWLEDGE, SKILLS, AND ABILITIES, OR CAN BE PERFORMED WITH REASONABLE TRAINING. NOTHING IN THIS JOB DESCRIPTION ALTERS THE AT-WILL EMPLOYMENT RELATIONSHIP OR LIMITS THE CREDIT UNION’S RIGHT TO ASSIGN OR REASSIGN DUTIES AND RESPONSIBILITIES TO THIS POSITION AT ANY TIME. #LI-Remote Job Details Job Family - Senior Professional Job Function - Senior Professional Pay Type - Salary Employment Indicator - Remote Hiring Min Rate - 102,000 USD Hiring Max Rate - 125,000 USD

California
$102K - $125K / year
Verantos logo

Senior Data Engineer

Verantos

High-validity real-world evidence across all therapeutic areas at scale

Data Engineer13 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Lead the design and evolution of the data platform architecture, establishing patterns and standards the team builds on. • Build and operate production-grade data pipelines that ingest and transform high-variance, real-world clinical data reliably and at scale. • Design for automation from the start: pipelines that detect problems, recover gracefully, and surface issues without requiring manual intervention to run. • Contribute to quarterly data product releases, working closely with product, clinical, customer success teams to meet commitments. • Build data quality tests that reflect the evolving needs of our downstream consumers. • Mentor and elevate other data engineers through code review, architecture decisions, and shared standards. • Actively use and advocate for AI tools that improve the team's development velocity and code quality.

California + 2 moreAll locations: California | New York | Washington
$150K - $220K / year

Role Description Estamos em busca de um(a) Auxiliar de Dados (MIGRAÇÃO) comprometido(a) e proativo(a) para se juntar à nossa equipe na ADVBOX. Se você tem paixão por conectar as pessoas aos seus direitos e quer fazer parte de um time que está transformando o mercado do direito digital, essa vaga é perfeita para você! - Contato por e-mail com o cliente para realizar a migração, fazer o atendimento e sanar as dúvidas de contas BJ E CRM; - Enviar os dados tratados e higienizados para validar com cliente; - Validar os dados tratados pelo cliente e com os que já constam na conta do cliente; - Documentar e registrar os procedimentos operacionais relacionados à migração dos dados; - Garantir que os dados coletados e higienizados estejam conforme a necessidade do cliente, corretamente relacionados à origem dos dados e no padrão ADVBOX; - Entregar as bases concluídas e validadas para importar na conta do cliente. Qualifications - Estar cursando Direito, Administração, Relações Públicas ou áreas correlatas; - Estar em uma fase de aprendizado e busca por oportunidades na carreira; - Vontade de aprender e crescer dentro de um ambiente colaborativo e dinâmico; - Perfil detalhista, organizado, influente, relacional, proativo e gostar de trabalhar em equipe. Requirements - Experiência em plataforma de gestão e na área de análise de dados; - Experiência em atendimento ao cliente; - Experiência com planilhas em Excel; - Familiaridade com o setor jurídico será um diferencial; - Ter realizado estágios na sua área de atuação; - Maturidade digital: google drive, aplicativos, gmail, whatsapp. Competências - Habilidade de comunicação e escrita; - Senso de urgência (agilidade); - Inteligência emocional; - Resolução de Problemas; - Autogerenciamento; - Bom ouvinte; - Organização e atenção a detalhes. Benefits - Oportunidades de crescimento e desenvolvimento profissional; - Ambiente de trabalho colaborativo e dinâmico; - Vale alimentação padrão R$ 1.100,00; - Comodato para aquisição de equipamentos: R$ 2.400,00 anual; - Seguro de vida e telemedicina; - Auxílio saúde de até R$ 400,00/mês; - Auxílio esportes de até R$ 200,00/mês; - Auxílio Internet de até R$ 100,00/mês; - Campanhas e ações especiais (Outubro Rosa, Novembro Azul, entre outras), com apoio e benefícios adicionais.

Brazil
Job Closed

Role Description Responsável pelo desenvolvimento, implementação e manutenção de soluções de dados escaláveis, confiáveis e de alta performance. Irá projetar e construir pipelines de dados, garantindo a integração, segurança e confiabilidade de dados de diversas fontes para atender às necessidades de aplicações internas e externas, bem como para suportar análises avançadas e a tomada de decisão estratégica da empresa. - Realizar a ingestão/Integrar dados de diversas fontes (bancos de dados relacionais e NoSQL, APIs de serviço interno e externos, arquivos e outros) e garantir a qualidade e consistência dos dados. - Implementar soluções de armazenamento de dados (Data Warehouses, Data Lakes) e otimizar o desempenho de consultas e processamento de dados. - Projetar, desenvolver e manter pipelines de dados (ELT) robustos e eficientes, utilizando as melhores práticas de engenharia de dados. - Garantir que todo o processo de ELT esteja funcionando por meio de monitoramento e métricas como SLA. - Monitorar a execução do ELT hospedados na nuvem e on-premises. - Disseminação de boas práticas de Devops e Dataops no time. - Colaborar com as equipes para fornecer soluções de dados que atendam às necessidades do negócio. - Documentar processos, arquiteturas e soluções de dados. Qualifications - Experiência em alguma linguagem de programação (Python, SQL, Spark). - Experiência com ambiente Linux. - Experiência com sistemas de controle de versão como GitHub, GitLab, Bitbucket, etc. - Conhecimento em algoritmos e estrutura de dados. - Interesse pela área de engenharia de dados. - Inglês intermediário. - Conhecimento básico com processamento de dados na nuvem (AWS, GCP, Azure, Snowflake, Databricks). Requirements - Formação em TI (Sistemas de Informação, Ciência da Computação, Engenharias, e afins). - Conhecimento básico do funcionamento de Data Warehouses como Google Bigquery, Redshift e/ou Snowflake. - Certificação em plataforma de nuvem pública (AWS, Azure, GPC) a nível Foundational ou equivalente. - Experiência com aplicações de data pipelines (Airflow, Dagster, etc). - Conhecimento de frameworks de processamento distribuído (Spark, Hadoop, Dask, etc). - Conhecimento básico em dbt. Benefits - Gestão moderna, transparente e inclusiva. - Ambiente dinâmico, aberto à inovação e criatividade. - Cultura orientada a dados (Data-driven). - Autonomia e engajamento. - Atmosfera leve e descontraída com foco em desafios. - Ambiente de alto crescimento (Escalonamento acelerado). - Trabalho remoto e horários flexíveis. - Plano de carreira estruturado. - Cultura de feedback e crescimento (avaliações de onboarding de 45/90 dias e ciclos de desempenho semestrais). - Programa de Mentoria para suporte dedicado durante o onboarding. - Time experiente e colaborativo. - Projetos de alto impacto. - Metodologias ágeis e equipes multidisciplinares. - Aulas semanais gratuitas de conversação em inglês. - Programa de Certificação (suporte financeiro total e recompensas por desempenho). - Oportunidades de tutoria na Indicium Academy. - Iniciativas internas como "Tech Tracks" e "Databloggers". - Escritórios globais em Florianópolis, São Paulo, Nova York, Lisboa e Londres. - Lanches e bebidas no escritório. - Programa de pontos e recompensas. - Zenklub. - Day off de aniversário. - Happy hours semanais e noites de jogos (remotos e presenciais). - Wellhub (antigo Gympass). - Plano de Saúde Bradesco. - Cartão Flash (benefícios flexíveis - total de R$ 1.350,00). - Bônus anual (baseado em desempenho). - Programa de Indicação (R$ 250 por contratação bem-sucedida). - Licença maternidade estendida (6 meses).

Americas + 1 moreAll locations: Americas | Europe
Job Closed