Patrianna logo
Patrianna

Fast growing product development company

Data Engineer

Data EngineerData EngineerContractRemoteSeniorTeam 51-200Since 2011H1B No SponsorCompany SiteLinkedIn

Location

Gibraltar

Posted

62 days ago

Salary

0

Seniority

Senior

Job Description

Data Engineer

Patrianna

• Develop batch and real-time data pipelines on our GCP platform • Develop APIs to share our data with other teams and consumers • Build CI/CD pipelines for automated deployments • Develop Terraform IAC for deploying our team's core infrastructure • Use Datastream to ingest CDC data to our data lake • Use Dataform and dbt to build a medallion data architecture • Optimize our BigQuery and ClickHouse data models • Build Airflow DAG pipelines for data imports and exports • Implement monitoring and alerting policies for data accuracy, consistency, and integrity across platforms • Uphold GDPR/CCPA compliance and data governance standards

Job Requirements

  • Good Bash, Git, SQL and Python - these are a must
  • Terraform IAC experience
  • Docker and K8s
  • Strong GCP experience (BigQuery, Dataform, Airflow, Datastream); API development and data modelling expertise;
  • Real-time processing - Kafka, Pyspark, Flink
  • Proven ETL/CI-CD skills
  • Bachelor's in Computer Science, Data Science, Information Systems, or equivalent
  • Google Cloud certifications (Professional Data Engineer, Cloud Architect) a plus
  • Passion for gaming and collaborative mindset

Benefits

  • Flexible remote options
  • Professional development budgets

Related Categories

Related Job Pages

More Data Engineer Jobs

Full TimeRemoteTeam 10,001+Since 2000H1B Sponsor

• Support in designing and implementing data platform architectures in Azure and on-premises, as well as data integration. • Collaborate with clients and team members—remote or onsite—across all project phases from requirements analysis to documentation. • Work on projects using technologies such as DevOps, SQL, Python, and more. • Actively participate in the community: share project experiences and knowledge through mutual exchange with colleagues.

Germany
Sicredi logo

Engenheiro de Dados Sênior

Sicredi

Não é só dinheiro, é ter com quem contar.

Data Engineer62 days ago
Full TimeRemoteTeam 10,001+H1B No Sponsor

• **Construir** pipelines de dados escaláveis, resilientes e de alta performance em Databricks e AWS. • **Desenvolver** soluções em Python e SQL, aplicando boas práticas, padrões e automação. • **Implementar** modelos de dados e camadas de processamento baseadas na arquitetura Lakehouse. • **Otimizar** jobs Spark, garantindo eficiência, governança e confiabilidade das cargas. • **Integrar** diferentes fontes de dados, garantindo segurança, qualidade e conformidade. • **Colaborar** com arquitetos e engenheiros na definição de soluções técnicas, padrões e práticas de engenharia. • **Apoiar** squads usuários da plataforma, fornecendo orientação técnica e suporte na adoção das soluções. • **Monitorar** pipelines, indicadores e performance, atuando proativamente na resolução de problemas. • **Documentar** soluções, fluxos, processos e padrões de engenharia. • **Contribuir** com iniciativas de modernização, automação e melhoria contínua da Plataforma de Dados e IA.

Brazil
Job Closed
Centene Corporation logo

Data Engineer II

Centene Corporation

Transforming the health of the communities we serve, one person at a time.

Data Engineer62 days ago
Full TimeRemoteTeam 10,001+Since 1984H1B No Sponsor

You could be the one who changes everything for our 28 million members by using technology to improve health outcomes around the world. As a diversified, national organization, Centene's technology professionals have access to competitive benefits including a fresh perspective on workplace flexibility. Position Purpose: Develops and operationalizes data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration. Engages with the DevSecOps Engineer during continuous integration and continuous deployment. - Designs and implements standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.) - Designs, develops, implements, tests, documents, and operates large-scale, high-volume, high-performance data structures for business intelligence analytics - Designs, develops, and maintains real-time processing applications and real-time data pipelines - Ensure quality of technical solutions as data moves across Centene’s environments - Provides insight into the changing data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions - Develops, constructs, tests, and maintains architectures using programming language and tools - Identifies ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated - Performs other duties as assigned - Complies with all policies and standards Education/Experience: A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science) and requires 2 – 4 years of related experience. Or equivalent experience acquired through accomplishments of applicable knowledge, duties, scope and skill reflective of the level of this position. Technical Skills: - One or more of the following skills are desired. - - ETL - SQL - Snowflake Pay Range: $63,600.00 - $114,600.00 per year Centene offers a comprehensive benefits package including: competitive pay, health insurance, 401K and stock purchase plans, tuition reimbursement, paid time off plus holidays, and a flexible approach to work with remote, hybrid, field or office work schedules. Actual pay will be adjusted based on an individual's skills, experience, education, and other job-related factors permitted by law, including full-time or part-time status. Total compensation may also include additional forms of incentives. Benefits may be subject to program eligibility. Centene is an equal opportunity employer that is committed to diversity, and values the ways in which we are different. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other characteristic protected by applicable law. Qualified applicants with arrest or conviction records will be considered in accordance with the LA County Ordinance and the California Fair Chance Act

United States + 1 moreAll locations: United States | Tunisia
$63.6K - $114K / year
Job Closed

Data Engineer - Azure

NTT DATA Services

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers, and application services. Our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.

Data Engineer62 days ago

Role Description We are currently seeking a Data Engineer - Azure to join our team in Remote, Karnātaka (IN-KA), India. - Advanced SQL programming for more than 4 years - Data analysis skills for more than 2 years - Experience with Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, Azure DevOps) - Demonstrate a proven track record of having implemented solutions using one or more agile methodologies in conjunction with a large system integration partner - Experience with Azure Data Factory and Databricks including orchestrating and designing data pipelines for secure data solutions are preferred - Industry certifications in Azure, Databricks or data architecture is advantageous - Understanding and knowledge of system development life cycle methodologies (such as agile software development, rapid prototyping, incremental, synchronize and stabilize, and DevOps) - Experience in migrating data and associated systems from on-prem to Cloud environments - Knowledge of advanced analytics (models, tools, etc.) and their operational support is a plus - Excellent verbal and written communication - Lloyds/Company Market (re)insurance experience with a good knowledge of London market or specialty insurance data domains and terminology is advantageous - Knowledge of data warehousing and ETL/ELT pipelines Qualifications - Strong technical proficiency in SQL, Python, and data integration tools - Hands-on experience with ETL tools and data orchestration (e.g., Azure Data Factory, Databricks) - Knowledge of data modelling, warehouse design, and architecture principles - Experience with cloud platforms (especially Azure) for building and operating data solutions - Understanding of Agile methodologies and tools (e.g., Jira, Azure DevOps) - Good communication skills to work with technical and business partners Company Description NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. - One of the world's leading AI and digital infrastructure providers - Unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers, and application services - Consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future - Global Top Employer with experts in more than 50 countries - Access to a robust ecosystem of innovation centers as well as established and start-up partners - Part of NTT Group, which invests over $3 billion each year in R&D

India
Job Closed