Job Closed
This listing is no longer active.
Simplify Your Life. Supercharge Your Shop.
Senior Data Engineer
Location
United States
Posted
135 days ago
Salary
0
Seniority
Senior
Job Description
Senior Data Engineer
Tekmetric
• Build scalable data pipelines using Python, Spark and Airflow to move data from different applications into our data lake. • Collaborate and influence the long term technology strategy and innovations roadmaps across data engineering areas. • Provide technical leadership, mentorship and growth to junior team members as we scale • Collaborate closely with engineering and product to elevate data generation approaches • Manage the end-to-end life cycle on the development of new features and pipelines • Ideate and contribute to shared data engineering tooling and standards. • Define and promote data engineering best practices across the company.
Job Requirements
- 5+ years experience in software engineering with a focus in data
- Expert in SQL and one or more programming languages (ideally Python, Java or Scala)
- Experience with ETL tools and frameworks (e.g., Apache Spark, Apache Airflow)
- Experience working with data modeling, data architecture design, and ETL pipelines
- Experience working with batching and streaming data infrastructure
- Familiarity with data visualization tools (Looker, Tableau, etc)
- You enjoy working in fast moving and dynamic environments
- Degree in Computer Science or Engineering
Benefits
- Enjoy the flexibility of remote work
- Competitive base salaries that reflect your value.
- Generous Paid Time Off, because we know you do your best work when you're well-rested.
- Support for every stage of life—with paid maternity, parental bonding, and medical leave for you or your loved ones.
- Comprehensive health benefits, including Medical, Dental, Vision, and Prescription coverage. For employee only, we offer plans that cover 100% of premiums and we cover 50% of costs for families.
- Prioritizing your mental health: get free, confidential counseling through our partnership with BetterHelp.
- 401(k) Retirement Savings Plan with 100% employer match on contributions up to 6% - so your future self will thank you.
- Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA) to make your money go further.
- Life and Accidental Death & Dismemberment (AD&D) Insurance for added peace of mind.
- Wellness on your terms: get up to $60/month toward fitness, mental health, or almost anything that helps you feel your best.
- After one year of employment, enjoy a $300 home office setup bonus to help make your space work for you.
- Keep growing with support for continuing education - we’re invested in your development.
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design, implement, and validate ETL/ELT data pipelines–for batch processing, streaming integrations, and data warehousing, while maintaining comprehensive documentation and testing to ensure reliability and accuracy. • Maintain end-to-end Snowflake data warehouse deployments and develop Denodo data virtualization solutions. • Recommend process improvements to increase efficiency and reliability in ELT/ETL development. • Stay current on emerging data technologies and support pilot projects, ensuring the platform scales seamlessly with growing data volumes. • Architect, implement and maintain scalable data pipelines that ingest, transform, and deliver data into real-time data warehouse platforms, ensuring data integrity and pipeline reliability. • Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions. • Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines. • Should be willing to stay informed and learn emerging methodologies in data engineering, and open source technologies.
• Perform data modeling by analyzing and structuring datasets to ensure proper relationships and adherence to industry best practices. • Handle special data by creating and managing equivalence tables, including specific cases such as “verticals”, aiming for greater standardization and efficiency. • Build pipelines that ensure full traceability from client file delivery through to loading into the Gold layer in Azure Databricks. • Identify opportunities for source-side automation to reduce reliance on manual files and increase efficiency. • Propose and implement efficient migration strategies, such as incremental loads, to avoid high costs from daily full loads. • Familiarity with code documentation. • Experience with agile methodologies. • Familiarity with developing process monitoring and alerts. • Ability to communicate technical solutions in a simple, pragmatic manner. • Proactive in supporting the team.
• Organization and Structuring of Data Repositories • Perform data modeling, analyzing and structuring datasets to ensure proper relationships and adherence to market best practices • Handle special data cases by creating and managing equivalence/mapping tables, including specific cases such as “verticals,” aiming for greater standardization and efficiency • Development of Data Pipelines and Flows • Build pipelines that ensure full traceability, from client file delivery through to loading into the Gold layer on Google Cloud Platform (GCP) • Identify opportunities for source-side automation to reduce dependence on manual files and increase efficiency • Migration and Optimization of Databases • Propose and implement efficient migration strategies, such as incremental loads, avoiding high costs associated with daily full loads • Familiarity with code documentation (desirable) • Experience with agile methodologies (desirable) • Skills in developing and optimizing APIs for data consumption (desirable) • Familiarity with developing monitoring and alerts for processes implemented on GCP (desirable) • Ability to communicate technical solutions in a simple and pragmatic way (soft skill) • Proactive in supporting the team (soft skill)
• Design, implement, and maintain robust, scalable data pipelines using Google Cloud Platform (GCP) and Amazon Web Services (AWS). • Develop and implement effective data models to support complex analytics and automated reporting. • Work closely with product teams and squads to understand business requirements and translate them into viable technical solutions. • Ensure data governance, quality, and compliance with established standards by implementing data engineering best practices. • Implement efficient ETL/ELT processes and optimize the performance of data pipelines to ensure data accuracy and integrity. • Provide technical support to resolve data integration issues and ensure continuous availability of data systems. • Actively participate in agile initiatives, collaborating in sprints and ceremonies to ensure high-quality, on-time deliveries.


