Job Closed
This listing is no longer active.
Building cutting-edge technology and data solutions for life insurance and annuities.
Senior Data Engineer
Location
United States
Posted
122 days ago
Salary
$134.5K - $158.5K / year
Seniority
Senior
Job Description
Senior Data Engineer
Bestow
• Transform and build robust solutions for transferring data from first and third-party applications to and from our data warehouse • Envision and design toward industry patterns on data exchange with our enterprise clients through a mix of traditional push delivery, cloud, and event-driven (eg: API, grpc) data sharing methods. • Support implementation and data integration as new partners roll onto the Bestow platform, and recommend improvements on configurability of platform. • Making decisions as a team. The things you build will be maintained and improved upon by others; there is a shared responsibility to make defensible design considerations and high collaboration. • Champion test-first design principles, proactively writing tests before code to maintain high coverage and pipeline reliability. • Develop hardened and repeatable (CI/CD) data models and pipelines to enable reporting, modeling and machine learning. • Ensure data quality through automated monitoring and alerting, and occasionally serving within an on-call rotation. • Leverage Google Cloud (GCP) tools (eg: Cloud Run, Cloud Functions, Vertex AI, App Engine, Cloud Storage, IAM, etc.) and services (eg: Astronomer - Apache Airflow) to bring data workloads to production. • Drive and support MLOps to improve Data Science monitoring and governance • Enable and support Generative AI (eg: LLM) pipelines, allowing internal teams to quickly prototype. Support the architecture and rollout of GenAI products and features into the marketplace. • Collaborate with product, engineering, stakeholders and data teams to deliver informed solutions to platform and client needs
Job Requirements
- 6+ years working in a data engineering role supporting incoming/outgoing products for internal and external customers.
- 4+ years demonstrated expertise in designing an end-to-end data pipeline in cloud frameworks (such as GCP, AWS, Azure) with requirements from multiple stakeholders.
- 4+ years of Python experience writing efficient, testable, and readable code
- 2+ years of experience in building streaming data ingestion pipelines
- 1+ year of ML (Machine Learning) support and implementation or MLOps.
- Advanced SQL expertise with columnar databases (BigQuery, Snowflake, Amazon Redshift) and performance tuning.
- Demonstrated experience with AI Coding assistants – AI tools are heavily engrained in Bestow culture.
- Cloud Native: Deep experience with cloud services (GCP preferred: Cloud Run, Pub/Sub, BigQuery) and containerization (Docker/Kubernetes).
- Demonstrated experience with AI Coding assistants – AI tools are heavily engrained in Bestow culture.
- Orchestration: Expert-level knowledge of Apache Airflow (DAG optimization, custom operators).
- Experience building CICD pipelines for data processing using tools such as Docker, CircleCI, dbt, git, etc
- Infrastructure as Code: Proven experience managing infrastructure using Terraform or Pulumi.
- Experience with creating alerts and monitoring pipelines which contribute to overall data governance.
- Familiarity with standard IT security practices such as identity and access management (IAM), data protection, encryption, certificate, and key management.
- Adaptability to learn new technologies and products as the job demands.
- Nice to have: Familiarity with building tools that draw upon Generative AI (GenAI) integrations (Enterprise-grade, not simply vibe-coded).
- Nice to have: experience with data contracts, data lakes, and API development
Benefits
- Competitive salary and equity based on role
- Policies and managers that support work/life balance, like our flexible paid time off and parental leave programs
- 100% paid-premium option for medical, dental, and vision insurance
- Lifestyle stipend to support your physical, emotional, and financial wellbeing
- Flexible work-from-home policy and open to remote
- Remote and WFH options, as well as a beautiful, state-of-the-art office in Dallas’ Deep Ellum, for those who prefer an office setting
- Employee-led diversity, equity, and inclusion initiatives
Related Guides
Related Categories
Related Job Pages
More Data Engineer Jobs
Senior Data Engineer – Data Architect, Automation-Led Modernization
Doran Jones Inc.Doran Jones Inc. is the leading financial services Data Engineering and Application Development firm.
• Assess legacy data and reporting workloads to identify where automation replaces manual effort. • Lead the migration of Informatica-based data workloads to Databricks, ensuring performance, reliability, and data integrity. • Design and execute an automation-first modernization strategy for data pipelines, reporting systems, and analytics platforms. • Apply tool-assisted and AI-assisted techniques to accelerate modernization while maintaining compliance and control. • Build repeatable frameworks and patterns for: Data ingestion, transformation, and orchestration; Reporting and analytics modernization; Data validation, reconciliation, and quality controls. • Establish governance to ensure modernization efforts are consistent, auditable, and scalable. • Partner with distributed data teams to deploy and scale modernization patterns across environments. • Provide hands-on technical leadership while remaining engaged in execution.
• Design & implement a modern data warehouse using Amazon Redshift, ensuring scalability and performance. • Develop and maintain ETL pipelines using AWS Glue (Python/PySpark), moving data from SQL Server (RDS) and other sources. • Structure our S3 data lake for efficient storage, partitioning, and integration with Redshift. • Define data models (star schema, dimensional modeling) to support reporting and analytics. • Establish data governance—documentation, quality checks, and monitoring for pipelines. • Collaborate with BI teams to ensure the warehouse meets reporting needs (CRM, dashboards). • Optimize costs by tuning Redshift clusters, managing Glue job efficiency, and automating workflows. • Troubleshoot data infrastructure issues and optimize performance across systems. • Contribute to the long-term vision for the data platform, including new tools, workflows, and process automation. • Maintain documentation of data systems, flows, and integration strategies. • Support project planning and estimation in coordination with business and technical teams
Senior Data Engineer
540We are a forward-thinking company that the Federal Government turns to in order to #GetShitDone
• Design, develop, and maintain scalable data pipelines and ETL processes using Python and AWS services • Build and deploy serverless functions using AWS Lambda for data processing and automation • Implement data integration solutions connecting diverse source systems to analytics platforms • Mentor junior data engineers through pair programming, code reviews, and technical coaching • Collaborate with data analysts and business stakeholders to understand requirements and deliver solutions • Optimize data pipeline performance, reliability, and cost efficiency in AWS environments • Develop and maintain comprehensive documentation for data systems and processes • Participate in on-call rotation to support production data infrastructure • Contribute to the establishment of team coding standards and engineering best practices • Work with Git for version control and participate in collaborative development workflows
Data Engineer
BuddleOffshoring Partner of Choice trusted by many innovative Australian & Global businesses since 2019.
• Design, build, and maintain ETL/ELT pipelines for structured and unstructured datasets • Process and analyze customer, operational, and financial transaction data • Develop scalable data workflows and reusable scripts for automation and reporting • Maintain data models, metric definitions, and analytics documentation • Optimize SQL queries and improve data processing performance and reliability • Integrate external data sources such as ABS and Census datasets into existing databases • Support cloud-based data platforms and modern data lakehouse environments • Build dashboards and reports for internal and external stakeholders • Translate business requirements into actionable analytics and reporting solutions • Support KPI tracking, operational reporting, and customer behavior analysis • Help identify trends, anomalies, and opportunities through data-driven insights • Collaborate with engineers, analysts, and stakeholders in agile environments • Participate in planning, testing, debugging, and deployment activities • Contribute ideas to improve workflows, system reliability, and engineering processes • Adapt quickly to changing priorities and evolving business requirements • Support development of reusable templates, modular scripts, and data engineering best practices • Support additional engineering or analytics initiatives as needed • Identify opportunities to improve processes, systems, and performance • Contribute to a collaborative and high-performing team environment • Assist in maintaining data quality, governance, and documentation standards




