Job Closed

This listing is no longer active.

Senior Data Engineer – MSI

Data EngineerData EngineerFull TimeRemoteSeniorTeam 1,001-5,000H1B No SponsorCompany SiteLinkedIn

Location

California

Posted

76 days ago

Salary

0

Seniority

Senior

Job Description

Senior Data Engineer – MSI

The Baldwin Group

• Collaborate with data architect, analysts, and stakeholders to identify and document needs/requirements for data pipelines and process automation • Design, build, document, test, and maintain data pipelines using industry best practices • Performs ETL, ELT operations in accordance with enterprise data governance and security standards • Develop data quality and governance process to ensure the accuracy and quality of the data through inspection, validation, processing, anomaly detection

Job Requirements

  • 5-7 years of relevant experience required
  • BA/BS in relevant discipline required
  • Vast experience with multiple development methodologies
  • Experience of building large, complicated data pipelines cross different platforms, data sources, data structures
  • Experience of working with relational databases such as SQL Server, Oracle, etc., and SQL scripting
  • Experience with Power BI
  • Experience of cloud platforms (like AWS, Azure, GCP) and its ETL tools and techniques of sourcing, maintaining, and updating data, data warehousing, data cleansing & transformation, etc.
  • Programming experience in Python, Spark, and other similar languages
  • Advanced programming knowledge and experience with large-scale processing engines are required, as well as a deeper understanding of database security and compliance tools.

Benefits

  • Health insurance
  • Retirement plans
  • Paid time off
  • Flexible work arrangements
  • Professional development

Related Categories

Related Job Pages

More Data Engineer Jobs

Leega logo

Senior Data Engineer – GCP, DBT

Leega

Inteligência, Inovação e Tecnologia.

Data Engineer76 days ago
Full TimeRemoteTeam 201-500Since 2010H1B No Sponsor

• Analysis and Planning of Loads/Pipelines: • Assess the data warehouse architecture and requirements. • Map data, transformations and processes in GCP services (Cloud Storage, BigQuery, Dataproc). • Define data migration strategy (full load, incremental, CDC). • Develop a data architecture plan on GCP. • Design and Data Modeling on GCP: • Design table schemas in BigQuery, considering performance, cost and scalability. • Define partitioning and clustering strategies for BigQuery. • Model data zones in Cloud Storage (Bronze, Silver and Gold). • ELT/ETL Pipeline Development: • Create data transformation routines using Dataproc (Spark) or Dataflow to load data into BigQuery. • Translate business logic and existing transformations into GCP. • Implement data validation and data quality mechanisms. • Infrastructure Provisioning and Management: • Use IaC tools (Terraform) to provision and manage GCP resources (BigQuery datasets/tables, Cloud Storage buckets, Dataproc clusters). • Configure and optimize Dataproc clusters for different workloads. • Manage networking, security (IAM) and access in GCP. • Performance and Cost Optimization: • Optimize queries in BigQuery to reduce costs and improve performance. • Tune and optimize Spark jobs on Dataproc. • Monitor and optimize GCP resource usage to control costs. • Data Security and Governance: • Implement and ensure data security in transit and at rest. • Define and apply IAM policies to control access to data and resources. • Ensure compliance with data governance policies. • Monitoring and Support: • Troubleshoot performance and functional issues of data pipelines and GCP resources. • Documentation: • Document the architecture, data pipelines, data models and operational procedures. • Communication: • Communicate effectively with team members, stakeholders and other areas of the company. • Ensure clear communication between architecture definitions and software components, and the evolution and quality of the team's deliverables. • Jira / Agile Methodologies: • Be familiar with agile methodologies, their ceremonies, and be proficient with the Jira tool.

Brazil
Full TimeRemoteTeam 10,001+H1B Sponsor

• Conduzir apresentações técnicas, workshops e treinamentos sobre soluções de dados na GCP; • Desenvolver e executar provas de conceito (PoCs) e demonstrações hands-on; • Apoiar clientes na construção de arquiteturas modernas de dados (data platforms); • Atuar na disseminação de soluções de Data Analytics, Machine Learning e AI; • Trabalhar em conjunto com Customer Engineers e Account Executives na qualificação de oportunidades; • Apoiar estratégias de adoção de produtos de dados da GCP; • Criar conteúdos técnicos e materiais de treinamento; • Interagir com clientes e parceiros em toda a América Latina; • Promover boas práticas em engenharia e arquitetura de dados na nuvem;

Brazil
Job Closed
Zipdev logo

Senior Data Engineer

Zipdev

Remote technical staffing from Latin America.

Data Engineer77 days ago
Full TimeRemoteTeam 51-200Since 2017H1B No Sponsor

• Architect and optimize the **Snowflake data platform**, including warehouse sizing, cost optimization, storage strategy, and access controls • Design and own **dbt project structure**, including models, macros, testing, documentation, and scalable data contracts • Build and maintain **ELT pipelines** using Fivetran and orchestration tools, ensuring reliable data ingestion across multiple sources • Implement and manage **data quality and observability frameworks** (tests, SLAs, lineage, monitoring, incident response) • Translate **business requirements into scalable data models and reusable datasets** • Partner with **Analytics, Product, and Marketing teams** to deliver high-quality, self-service data solutions • Establish and enforce **data modeling standards** (dimensional and ER models) • Optimize **query performance and warehouse costs** in Snowflake, providing insights to stakeholders • Define and enforce **data governance policies**, including RBAC, masking, and PII handling • Own end-to-end delivery of **complex data initiatives**, from design to production • Participate in **code reviews and technical design discussions**, raising engineering standards • Identify and reduce **technical debt** across pipelines, models, and infrastructure

Brazil
Job Closed
Waylin Partners logo

Manager – Data Engineering

Waylin Partners

Waylin Partners streamlines FP&A, Data Analytics, and Technical Accounting for private equity portfolio companies.

Data Engineer77 days ago
Full TimeRemoteTeam 11-50Since 2022H1B No Sponsor

• Design, build, and optimize data warehouses, pipelines, and ETL/ELT processes to support enterprise reporting and analytics • Translate ambiguous business questions into scalable, data-driven solutions that help leaders make informed decisions • Develop automated reporting and analytics workflows, ensuring data accuracy, consistency, and timeliness • Build and maintain dashboards and visualization tools that synthesize complex data for finance and operational leadership • Partner with finance, accounting, and operational teams across portfolio companies to understand data needs and implement effective solutions • Implement best practices for data governance, data quality, and system architecture • Support integration efforts during acquisitions, system migrations, and new tool onboarding

United States
Job Closed