Job Closed
This listing is no longer active.
The world's most productive AI Workspace for projects, tasks, chat, docs, and more. All software and humans - converged.
Senior Data Engineer
Location
United States
Posted
100 days ago
Salary
$139K - $181.5K / year
Seniority
Senior
Job Description
Senior Data Engineer
ClickUp
• Design, build, and maintain cloud-native data infrastructure using Terraform for IaC. • Develop and optimize data pipelines leveraging AWS services (Lambda, Fargate, Step Functions, S3, Kinesis, DynamoDB, Aurora, etc.) and Snowflake. • Implement ELT workflows within dbt in partnership with our Analytics Engineering function. • Build and maintain LLM frameworks, ensuring high-quality and cost effective outputs. • Automate infrastructure and pipeline deployments with CI/CD best practices. • Monitor, debug, and improve system performance with strong observability and logging practices. • Partner with cross-functional teams (analytics, data science, product, engineering) to deliver high-quality data solutions. • Mentor teammates and contribute to engineering standards, raising the technical bar across the team.
Job Requirements
- 5+ years of professional experience in data engineering or software engineering, with emphasis on scalable data systems.
- Deep experience with AWS cloud services (especially Lambda, Fargate, Step Functions, S3, DynamoDB, Aurora).
- Hands-on expertise in Terraform and/or AWS CDK for managing infrastructure as code.
- Strong knowledge of SQL and experience with Snowflake or another cloud data warehouse.
- Proficiency with dbt and modern ELT patterns.
- Solid coding skills in Python (or another general-purpose language).
- Experience building pipelines to support AI/ML workflows (feature engineering, training data pipelines, model monitoring).
- Understanding of CI/CD workflows, Git-based development, and containerization (Docker).
- Knowledge of data quality, governance, and observability best practices.
- Experience in both startup and enterprise environments, with ability to adapt to fast-changing priorities while maintaining quality.
- Familiarity with orchestration frameworks (Airflow, Dagster, Prefect).
- Knowledge of streaming/event-driven architectures (Kinesis, Kafka).
Benefits
- Equity
- 401k
- Health, Dental, and Vision insurance
- Spending accounts
- Life & Disability
- Paid parental leave
- Flexible paid time off
- Enhanced employee assistance program
- Employee wellness stipend
- Professional development stipend
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
• Design and implement a scalable, robust, and consistent data architecture, aligned with business objectives, that supports both operational and analytical needs. • Own and support data pipelines integrating data sourced across multiple systems. Deliver a highly available data platform leveraged by business users across the enterprise. • Partner with engineering teams to integrate AI and machine learning models into the data architecture, enabling predictive analytics, automation, and improved decision-making capabilities. • Work closely with business and project stakeholders to deliver data solutions for a diverse set of problems. • Help ensure security, privacy, and compliance for all data assets and workflows. • Create comprehensive documentation for data processes, structures, and pipelines. Provide training and support to ensure best practices are followed throughout the organization. Design and develop data pipelines for data collection, analysis, and related functions. • Establish and enforce data governance standards, ensuring data consistency, accuracy, and integrity across all systems and departments. • Provide thought leadership for technical architecture design, development, and deployment to support enterprise-wide data needs.
Data Engineer – Databricks Focus
AbstraPersonalized solutions and expert guidance from your trusted nearshore partner.
• Plays a leadership role in the analysis, design, development, documentation, implementation and maintenance support of data management platforms for all areas of the Bank through the project life-cycle and across single or multiple systems. • Investigates and trains other staff on identification of program errors, definition of problems, debugging, unit testing and implementation of changes. • Trains junior staff in data engineering concepts, standards, and best practices. • Provides training, assistance, and guidance for maintenance support of existing Bank applications, data management and analytics platforms and related package products as directed. • Interfaces with other data engineering, and data science teams to implement bank initiatives. • Demonstrates technical leadership by staying abreast of emerging data engineering technologies and implementing industry best practices. • Lead developing data solutions, provide subject matter expertise utilizing SQL Server, .net and Microsoft Azure technology stack and other relevant technologies in coordination with Enterprise Architects. • Actively leads process improvement initiatives. • At times, may be responsible to lead process improvement initiatives. • Reports task progress to applicable stakeholders. • Performs other duties as assigned.
Data Architect, Databricks focus
AbstraPersonalized solutions and expert guidance from your trusted nearshore partner.
• Work closely with team members on analysis, design, development, documentation, implementation and support of data design and modeling needs throughout the SDLC. • Provide vision, direction and leadership to improve the Data Architecture of the client. • Work collaboratively with staff to provide architectural guidance and leadership in the design and implementation of all active projects. • Lead design and technical problem-solving meetings focusing on technologies, proof of concept activities, and models related to data management. • Maintain a clear understanding of client’s strategic initiatives and requirements for shared data assets to evaluate current and emerging technologies and industry trends. • Collect, analyze and manipulate complex information in order to summarize and present recommendations that impact business decisions.
Data Architect – Azure Data Factory
AbstraPersonalized solutions and expert guidance from your trusted nearshore partner.
• Design, implement, and maintain Azure Data Factory pipelines for ingestion, transformation, and orchestration of data workflows. • Consume and process data from various structured and unstructured internal and external data sources. • Build scalable data models to support reporting and analytics use cases. • Develop and maintain dashboards and reports using BI tools (e.g., Power BI, Tableau, or similar). • Identify, troubleshoot, and resolve current data issues, ensuring data accuracy, reliability, and performance. • Implement best practices for data governance, security, quality, and documentation. • Collaborate closely with data analysts, data scientists, engineers, and business stakeholders. • Optimize data processes for performance, cost-efficiency, and scalability. • Monitor, test, and validate the performance of data flows and pipelines.


