Job Closed
This listing is no longer active.
We make the Aspirational Attainable. We Do Better Together to Deliver Real Change.
Data Engineer
Location
United States
Posted
100 days ago
Salary
$100K - $250K / year
Seniority
Senior
Job Description
Data Engineer
RE Partners
• Design and build Spark data ETL pipelines on AWS data platform • Collaborate with cross functional teams (data scientists, fraud, marketing) to understand data needs and deliver solutions • Optimize data infrastructure • Ensure data quality and reliability • Innovate and follow best practices • Ensure operational excellence of the data platform
Job Requirements
- Professional experience working in data warehousing, data architecture, and/or data engineering environments
- Proficiency in at least one high-level programming language (Scala, Java, Python or equivalent)
- Good understanding of databases
- Built large-scale data products
- Deep understanding of system design, data structures, and algorithms
- Excellent knowledge of distributed computing frameworks such as Hadoop MapReduce, Spark
- Strong knowledge of following AWS infrastructure - EMR, S3, Lambda, Redshift etc
- Strong understanding of data quality, governance
- Team player, self-driven, highly motivated individual who loves to learn new things.
Benefits
- Referral bonus
- Equal Opportunity Employer
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Build CDC pipelines and real-time streaming (Kafka/Flink) • Design and maintain data models (raw to staging to core) • Implement observability, data transformations and quality checks • Own schema design for multi-tenant analytics • Tune query performance (Trino) and optimize storage (Iceberg compaction, indexing) • Support BI and analytics workloads • Contribute to infrastructure, CI/CD • Assist with infrastructure monitoring and observability
Senior Data Engineer, ADF, Databricks
BilligenceWe are a global BI Consultancy & Contingent Labor provider, focusing on contract IT recruitment and staff augmentation
• Design, develop, and maintain Azure Data Factory (ADF) pipelines for reliable data ingestion and orchestration • Develop and optimize Databricks notebooks for large-scale data processing and transformations • Implement robust ELT/ETL processes integrating multiple data sources into Snowflake • Perform data modeling using modern approaches, including Data Vault 2.0 • Write, optimize, and maintain complex SQL statements and SQL scripts • Ensure data quality, performance optimization, and scalability across data pipelines • Collaborate with stakeholders, data architects, and downstream analytics teams to deliver high-quality data solutions • Troubleshoot, monitor, and improve existing data workflows in production environment
Senior Data Engineer – Azure, Apache Kafka
BilligenceWe are a global BI Consultancy & Contingent Labor provider, focusing on contract IT recruitment and staff augmentation
• Design, develop, and maintain scalable data pipelines on Microsoft Azure • Build and manage real-time and batch data processing solutions using Kafka, Spark, and Python • Develop and optimize ETL/ELT workflows using Azure Data Factory (ADF) • Work extensively with Databricks for large-scale data processing and analytics • Design, develop, and optimize Snowflake data models and queries • Write efficient and optimized SQL for data transformation and analysis • Process and manage structured and semi-structured data, including XML and JSON formats • Collaborate with cross-functional teams to support data-driven solutions • Ensure data quality, reliability, performance, and scalability of data systems • Follow best practices for cloud infrastructure, security, and performance optimization
Senior Data Engineer
Digible, IncDigible provides advanced digital marketing and technology solutions for the multifamily housing industry.
• Own our Bronze data layer: build and maintain ingestion pipelines from third-party APIs, transform via dbt, orchestrate via Prefect • Partner with Product and Engineering on Silver-layer modeling — ensuring data is clean, documented, and governed as it moves toward consumption • Enable upstream teams to own their Gold-layer data well — establishing best practices, governance standards, pipeline automation, and tooling so teams can build confidently without it becoming the wild west • Troubleshoot pipeline failures and data quality issues, driving toward root cause and long-term fixes • Contribute to platform evolution — identifying opportunities to optimize, refactor, or scale our data infrastructure • Stay informed on developments in the modern data stack and introduce tools and processes that improve our development workflows



