Job Closed

This listing is no longer active.

Hauler Hero logo
Hauler Hero

Delivering Technology for Waste & Recycling Hauler Operators

Staff Data Engineer

Data EngineerData EngineerOtherRemoteLeadTeam 11-50Since 2020H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

94 days ago

Salary

0

Seniority

Lead

Bachelor DegreeEnglishETLHibernatePandasPythonSQL

Job Description

Staff Data Engineer

Hauler Hero

• Own the end-to-end architecture of the data migration platform, from ingestion through validation to production deployment • Design migration infrastructure that reduces per-customer engineering effort through reusable components and standardized patterns • Build systems that evolve migrations from engineer-led to standardized and self-service • Establish automated data quality frameworks including profiling, validation, and anomaly detection • Instrument migration systems with dashboards, metrics, and alerts for observability and continuous improvement • Architect self-service import workflows for customers and internal teams • Design ingestion pipelines that align tightly with Hibernate entity models and lifecycle rules • Build intelligent error handling and feedback loops that guide non-technical users through data correction • Create Excel-based import templates with embedded validation, documentation, and formatting standards • Maintain alignment with application changes by tracking Hibernate model evolution and updating pipelines proactively • Design, build, and maintain ETL pipelines for migrating data from legacy waste management systems • Analyze legacy datasets, reverse-engineer business logic, and implement transformation workflows • Execute end-to-end customer migrations in coordination with technical and business stakeholders • Build tooling to ingest data from legacy LAN-based systems common in the industry • Optimize pipeline performance to handle large datasets efficiently and reduce migration timelines • Drive technical decisions for data infrastructure, including build vs. buy evaluations • Partner with Product, Engineering, and Customer Success to shape scalable solutions • Mentor team members on data integration and migration patterns • Create and maintain documentation, runbooks, and operational guides • Lead code reviews and knowledge sharing to raise the bar across the team

Job Requirements

  • Advanced SQL expertise including query optimization and schema design
  • Advanced Python proficiency with:
  • SQLAlchemy (ORM and Core)
  • Pandas for transformation and profiling
  • Data validation frameworks (Pydantic or similar)
  • Deep experience with Hibernate or similar ORMs, including lifecycle and performance implications
  • Proven track record building frameworks and platforms, not just pipelines
  • Strong Git and collaborative development practices
  • Experience designing data architectures for transformation, metadata, and orchestration
  • History working with large, disconnected datasets
  • Strong computer science fundamentals and commitment to maintainable code.

Benefits

  • Competitive salary + equity
  • Health, dental, vision insurance
  • Flexible PTO
  • Remote-first culture
  • Modern development tools and AI assistants

Related Categories

Related Job Pages

More Data Engineer Jobs

OtherRemoteTeam 1,001-5,000H1B No Sponsor

• Define and implement the end-to-end architecture for the Lakehouse, ensuring support for high-volume batch processing, real-time streaming, and GenAI/LLM initiatives using Mosaic AI and MLflow • Design solutions that prioritize data quality at the source • Establish and enforce architectural patterns that ensure reliability and trust in data assets • Implement automated testing and observability frameworks (e.g., Delta Live Tables expectations) to maintain data health • Translate complex business requirements into robust logical and physical data models • Document and maintain clear data flow architectures for applications to ensure alignment between business intent and engineering output • Lead virtual Scrum teams and provide deep technical mentorship to data engineers and developers • Advocate for Spark/Databricks best practices, conduct code reviews, and drive the adoption of CI/CD and DevOps principles in data workflows • Architect the frameworks for data lineage, security, and lifecycle management (utilizing Unity Catalog) • Ensure strict compliance with internal policies and external regulations from the point of data ingestion to final consumption • Partner directly with business stakeholders to understand their roadmap and priorities • Ensure all data and AI initiatives are strictly aligned with tangible business value • Manage the architectural roadmap to balance immediate business needs with long-term technical scalability

Florida
Job Closed
Sur Global logo

Lead Data Engineer

Sur Global

We don’t just partner with you, we accelerate your progress and fuel your growth.

Data Engineer94 days ago
Full TimeRemoteTeam 501-1,000H1B No Sponsor

• Architect, implement, and maintain scalable data pipelines across core systems. • Build and manage analytics infrastructure using both open-source and commercial tools. • Ensure data quality and schema discipline for operational reliability. • Deliver clean, consistent models and dashboards utilized by multiple teams. • Collaborate with stakeholders to support analytics, business intelligence, and decision-making initiatives.

Argentina
$4K - $7K / month
Job Closed
Decision Foundry logo

Database, Data Warehouse Developer

Decision Foundry

A Global, Salesforce Marketing Cloud Implementation Partner.

Data Engineer94 days ago
OtherRemoteTeam 201-500H1B No Sponsor

• Develop, and maintain database solutions and data warehouse architectures using MSSQL 2019/2022 and MySQL 8. • Collaborate with stakeholders to gather requirements and understand business needs for data storage and processing. • Develop and maintain ETL processes using SSIS, BIML, and DBT to ensure efficient data integration and transformation. • Implement and manage solutions within Power BI Fabric for enterprise-scale data analytics. • Write complex SQL queries, stored procedures, functions, and triggers to support application and reporting requirements. • Optimize query performance through indexing strategies, execution plan analysis, and database tuning techniques. • Troubleshoot and resolve database performance issues, data integrity problems, and system bottlenecks. • Monitor database health, perform capacity planning, and implement proactive maintenance strategies. • Develop automation scripts using PowerShell and Python to streamline database operations and maintenance tasks. • Ensure data security, backup and recovery procedures, and compliance with organizational standards. • Utilize version control tools such as Git and project management tools like Jira and Confluence or similar platforms as required. • Work effectively in a team environment, collaborating on concurrent developments and contributing to team success. • Document database architectures, ETL processes, standards, and procedures. • Stay current with database technologies, best practices, and emerging trends in data warehousing. • Provide technical guidance and support to team members and end-users as needed. • Contribute to continuous improvement initiatives related to data management and analytics infrastructure.

United States
$110K - $140K / year
Job Closed
2COMS Consulting Pvt. Ltd. logo

SQL Data Migration Specialist

2COMS Consulting Pvt. Ltd.

Recruitment I General Staffing I IT Staffing I GigForce I Apprenticeship Implementation I Hire Train Deploy

Data Engineer94 days ago
Full TimeRemoteTeam 10,001+Since 1999H1B No Sponsor

• Lead data analysis, mapping, and transformation efforts • Collaborate with project teams to define requirements • Perform comprehensive data analysis and cleansing • Develop, test, and implement SQL-based ETL scripts • Validate migration outcomes through rigorous testing

India