Job Closed

This listing is no longer active.

eSimplicity logo
eSimplicity

An engineering firm that delivers high-quality Healthcare IT, Cybersecurity, and Telecommunication solutions.

ETL Pipeline Developer, Data Engineer

Data EngineerData EngineerOtherRemoteLeadTeam 51-200Since 2016H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

119 days ago

Salary

$110 / hour

Seniority

Lead

Job Description

ETL Pipeline Developer, Data Engineer

eSimplicity

• Work collaboratively with Product Managers, Designers, and Engineers to set up, develop, and maintain critical back-end integrations for data and analytics platform. • Create and maintain new and existing data pipelines, Extract, Transform, and Load (ETL) processes, and ETL features using Azure cloud services. • Build, expand, and optimize data and data pipeline architectures. • Optimize data flow and collection for cross functional teams of database architects, data analysts, and data scientists. • Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality. • Assemble large, complex sets of data that meet non-functional and functional business requirements. • Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes. • Develop and document standard operating procedures (SOPs) for new and existing data pipelines. • Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition. • Write unit and integration tests for all data processing code. • Read data specifications and translate them into code and design documents.

Job Requirements

  • All candidates must pass public trust clearance through the U.S. Federal Government.
  • Bachelor's degree in Computer Science, Software Engineering, Data Science, Statistics, or related technical field.
  • 8+ years of experience in software/data engineering, including data pipelines, data modeling, data integration, and data management.
  • Expertise in data lakes, data warehouses, data meshes, data modeling and data schemas (star, snowflake…).
  • Extensive experience with Azure cloud-native data services, including Synapse, Data Factory, DevOps, KeyVault, etc.
  • Expertise in SQL, T-SQL, and Python with applied experience in Apache Spark and large-scale processing using PySpark.
  • Proficiency with data formats: parquet, distributed snappy parquet, and .csv.
  • Understanding of common connection protocols, such as SFTP.
  • Proven ability to work with incomplete or ambiguous data infrastructure and design integration strategies.
  • Excellent analytical, organizational, and problem-solving skills.
  • Strong communication skills, with the ability to translate complex concepts across technical and business teams.
  • Proven experience working with petabyte-level data systems.

Benefits

  • Highly competitive salary
  • Full healthcare benefits

Related Categories

Related Job Pages

More Data Engineer Jobs

Stride, Inc. logo

Data/Infrastructure Advocate Engineer - US Remote

Stride, Inc.

Stride, Inc., formerly known as K12 Inc., is a leading provider of personalized online education programs and services, including customized tutoring, online ed

Data Engineer119 days ago

At Hugging Face, we’re on a journey to democratize good AI. We are building the fastest growing platform for AI builders with over 5 million users & 100k organizations who collectively shared over 1M models, 300k datasets & 300k apps. Our open-source libraries have more than 400k+ stars on Github. About the Role As our first Data/Infrastructure Advocate Engineer, you’ll bridge the gap between cutting-edge data infrastructure and the global community of data engineers, researchers, and developers. You’ll champion Xet storage on the Hugging Face Hub, empowering users to efficiently store, version, and collaborate on large-scale datasets. This role is for someone who thrives at the intersection of technical depth (storage, Parquet, deduplication) and community advocacy—helping define the future of open data workflows. You’ll collaborate with teams like Datasets, Hub, and Infrastructure to shape how developers interact with data on our platform, and inspire a community to build better, faster, and more scalable data pipelines. Your Main Missions: - Grow and nurture the open-source data/infra community—launch initiatives, collaborate with data-focused groups, and organize events or challenges. Engage with communities like Apache Parquet, Open Tables Formats, and data engineering forums to promote best practices and Hugging Face tools. - Promote the Hugging Face Hub as the go-to platform for data storage, versioning, and collaboration—curate and showcase datasets, benchmarks, and tools like Xet. - Highlight use cases like efficient large dataset updates, Parquet editing, and deduplication to demonstrate the Hub’s value for data workflows. - Create demos, benchmarks, and tools (e.g., Colab notebooks) to illustrate best practices for data storage and versioning.bExperiment with Xet, Parquet, and other data formats to showcase their potential for ML and data engineering. - Produce high-quality tutorials, blog posts, and videos that make complex topics accessible. - Share insights on storage optimization, dataset versioning, and deduplication to empower developers. - Actively participate in online communities (Discord, GitHub, forums) to highlight contributions, answer questions, and foster collaboration. - Ensure datasets and tools released on the Hub are well-documented, with clear examples, benchmarks, and use cases. About you You’re a great fit if you: - Have strong technical skills in Python, data libraries (e.g., pandas, pyarrow, huggingface/datasets), and storage systems (Parquet, Open Table Formats, S3). - Are a hands-on builder who loves experimenting with data tools, storage optimization, and dataset versioning. - Can clearly explain complex topics (e.g., deduplication, compression, Parquet editing) through writing, demos, or talks. - Are active in developer communities (GitHub, Discord, forums) and passionate about open source and knowledge sharing. - Thrive in fast-moving environments and enjoy building in public to inspire others. If you're interested in joining us but don't tick every box above, we still encourage you to apply! We're building a diverse team whose skills, experiences, and backgrounds complement one another. We're happy to consider where you might be able to make the biggest impact. More about Hugging Face We are actively working to build a culture that values diversity, equity, and inclusivity. We are intentionally building a workplace where you feel respected and supported—regardless of who you are or where you come from. We believe this is foundational to building a great company and community, as well as the future of machine learning more broadly. Hugging Face is an equal opportunity employer, and we do not discriminate based on race, ethnicity, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or ability status. We value development. You will work with some of the smartest people in our industry. We are an organization that has a bias for impact and is always challenging ourselves to grow continuously. We provide all employees with reimbursement for relevant conferences, training, and education. We care about your well-being. We offer flexible working hours and remote options. We offer health, dental, and vision benefits for employees and their dependents. We also offer parental leave and flexible paid time off. We support our employees wherever they are. While we have office spaces in NYC and Paris, we're very distributed, and all remote employees have the opportunity to visit our offices. If needed, we'll also outfit your workstation to ensure you succeed. We want our teammates to be shareholders. All employees have company equity as part of their compensation package. If we succeed in becoming a category-defining platform in machine learning and artificial intelligence, everyone enjoys the upside.

New York
Job Closed
Upstart 13 logo

Data Engineer, SQL, ADF

Upstart 13

Bringing down borders in technology.

Data Engineer120 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

• Code SQL for both on-premises and Azure SQL environments, including optimizing queries, data manipulation, and ensuring high performance. • Design and build data pipelines from various data sources (mainly databases) to a target Data Warehouse / Lakehouse, using batch data load strategies, and leveraging Microsoft Azure technologies (Data Factory and Databricks). • Implement data validation and quality assurance checks to maintain high data integrity standards, ensuring accurate and reliable data for analytical purposes. • Collaborate with a cross-functional team of business analysts, architects, engineers, data analysts, and key stakeholders to formulate and implement data pipelines. • Participate in architecture discussions, take ownership and responsibility over new projects or requirements, and perform audits to ensure data quality and integrity. • Utilize programming languages, databases & cloud Data Warehouses / Lakehouses. • Document database designs that include data models, metadata, ETL specifications, and process flows for business data project integrations. • Monitor, maintain, and optimize production systems. • Investigate and resolve incidents reported by users. • Identify opportunities to automate, consolidate, and simplify data solutions at scale. • Define best practices and create coding standards and patterns that can be reused by the rest of the data engineers.

Brazil
Job Closed

• Assist in building and maintaining EDP data pipelines using Python, Airflow, DBT, and Snowflake. • Support ingestion and transformation of financial datasets following established data standards. • Develop DBT models with basic testing, documentation, and data quality checks. • Create and monitor Airflow DAGs with dependencies, retries, alerts, and backfills under guidance. • Help troubleshoot pipeline issues, perform routine checks, and support schema changes. • Collaborate with analysts and platform teams; participate in reviews, sprints, POCs, and reusable frameworks.

India
Job Closed

• Architect, design, and deliver end-to-end EDP data solutions using Python, Airflow, DBT, and Snowflake • Lead complex, cross-system data pipeline initiatives • Define and govern enterprise-wide data modelling and transformation frameworks • Set strategic direction for orchestration, monitoring, reliability, and operational excellence • Establish robust data quality, governance, security, and compliance frameworks • Act as a technical leader and domain expert—mentoring engineers and influencing architecture

India
Job Closed