Job Closed

This listing is no longer active.

Vanta Inc. logo
Vanta Inc.

Vanta Inc. is a software development company that is on a mission “to secure the internet and protect consumer data.” As an employer, the company strives to

Senior Data Engineer

Location

United States

Posted

3 days ago

Salary

$190K - $224K / year

Seniority

Senior

Bachelor Degree5 yrs expEnglishAirflowAmazon RedshiftAWSBigQuerySQLTerraform

Job Description

Senior Data Engineer

Vanta Inc.

• Design and deploy data infrastructure needed to drive data-driven decision-making solutions • Design and implement complex data orchestration models, modeling metadata, scaling reporting tools for data science and ML products users • Be the company’s expert on data administration, data management and scalable data systems • Write highly tuned, scalable SQL queries running over large-scale, heterogeneous data warehouses • Work with the Product and Enterprise Engineering system teams to structure source systems for reporting consumption across the enterprise • Help maintain CDC pipelines to power customer reporting • Help develop front end applications to expose analytical data sets enterprise wide

Job Requirements

  • At least four years of experience working with data and two years of experience in Software Engineering or a related field.
  • Experience with common analytics tooling (e.g. Stitch/Fivetran, Snowflake/BigQuery/Redshift, dbt, Airflow, Dagster).
  • Good working knowledge of AWS data infra systems and Terraform.
  • A system-oriented and software engineering mindset to the Data Engineering practice.
  • Deep knowledge of crafting dimensional and fact models in modern data fashion
  • A passion for enabling the developer experience of data.
  • Open to using AI to amplify their skills and strengthen their work.

Benefits

  • Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans
  • 16 weeks fully-paid Parental Leave for all new parents
  • Health & wellness stipend
  • Remote workspace, internet, and cellphone stipend
  • Commuter benefits for team members who report to the SF and NYC office
  • Family planning benefits
  • Matching 401(k) contribution with immediate vesting
  • Flexible PTO policy, plus 80 hours of Sick Time
  • 11 company-paid holidays
  • Virtual team building activities, lunch and learns, and other company-wide events!

Related Categories

Related Job Pages

More Data Engineer Jobs

Role Description The Data Migration Lead will own end-to-end data migration activities for NetSuite implementations and enhancements, ensuring data quality, accuracy, and successful cutover execution. Key Responsibilities - Define migration strategy and execution roadmap. - Lead data discovery, profiling, and assessment activities. - Develop data mapping and transformation rules. - Manage data cleansing and enrichment initiatives. - Execute mock migrations and validation cycles. - Perform reconciliation and data quality checks. - Coordinate business sign-offs and migration approvals. - Support cutover planning and go-live activities. - Develop migration documentation and governance processes. Qualifications - 7+ years of ERP data migration experience. - Hands-on experience with NetSuite data migration projects. - Strong knowledge of ETL processes and data quality methodologies. - Expertise in data reconciliation and validation. - Experience working with large and complex datasets. Preferred Qualifications - Experience with Celigo, Boomi, Informatica, or other ETL tools. - Knowledge of financial, customer, inventory, and operational data domains.

EST (UTC-5)

Role Description We have a contract opportunity for Lead Data Engineer (Remote) with one of our clients. Detailed job descriptions are provided below. - Title: Lead Data Engineer (Microsoft Fabric) - Duration: 9+ Months - Work location: Remote (USA) - Visa Restrictions: US Citizen or Green Card only due to the nature of the job - LinkedIn profile with picture is mandatory Qualifications - 8+ years of Data Engineering experience - 3-4+ years of hands-on experience with Microsoft Fabric - Strong experience with: - Microsoft Purview - Fabric Data Pipelines - Fabric Data Warehouse - OneLake - PySpark Notebooks - SQL & Python - Metadata-driven ETL/ELT frameworks - Power BI - Azure DevOps, Git, CI/CD - Experience handling PII data, data governance, lineage, and compliance - Experience provisioning and administering Fabric Workspaces - Leadership experience (Lead Data Engineer/Technical Lead) Requirements - Enterprise Data Warehouse implementations - Azure Data Platform experience - Data Governance and Metadata Management projects - Large-scale analytics and reporting environments

United States

Role Description Allocate is looking for a Senior Data Engineer to help build out the data infrastructure that powers our analytics, reporting, and data-driven product features. In this role, you will partner closely with our data lead to model core financial entities, integrate internal and external sources, and build the pipelines and infrastructure that let our engineering and product teams make informed decisions and ship compelling features. This is a fully remote position where you will work alongside our backend team (C#/.NET) and frontend team (Node/Vue.js) to integrate data pipelines into our platform. Responsibilities - Build and Extend Data Architecture: - Build on and extend Allocate's data lakehouse on AWS. - Contribute to our knowledge graph that models key relationships (investors, funds, companies, etc.). - Integrate vector database for semantic search and retrieval across AI agents, models, and providers. - Develop Data Pipelines: - Create robust ETL/ELT pipelines to ingest, clean, and transform data. - Ensure both batch processing and real-time data streaming are handled. - Build pipelines with scalability and reliability in mind. - Enable AI/ML Capabilities: - Work closely with data science and engineering team to provision data and infrastructure for machine learning models. - Prepare training datasets and set up feature stores. - Orchestrate workflows that feed LLM-based agents with the necessary context. - Engineering Excellence and Collaboration: - Partner with data lead and engineering team to deliver data and AI infrastructure. - Raise the bar through code review, testing, and adherence to best practices. - Work in cross-functional squads to incorporate data-driven features into the product roadmap. - Infrastructure and DevOps: - Collaborate with DevOps engineers to deploy and maintain data services. - Containerize and orchestrate data tools using Docker/Kubernetes on AWS EKS. - Implement CI/CD pipelines for data workflows. - Monitor the health and performance of data platforms. - Continuous Improvement: - Stay up to date with the latest in data engineering and AI. - Evaluate and recommend new technologies to improve pipeline reliability. - Encourage rethinking how things are done to build a world-class platform. Qualifications - 5+ years of hands-on experience in data engineering or related fields. - Strong experience working with AWS cloud services for data. - Proficiency in SQL and relational database design. - Fluency in at least one major programming language used in data engineering. - Understanding of machine learning models and data consumption. - Solid understanding of containerization and deployment. - Strong analytical and problem-solving skills. - Experience working in a regulated SEC environment. - Excellent communication skills and a collaborative mindset. - Bachelor’s degree in Computer Science or equivalent practical experience. Requirements - Experience with tools like S3, EC2, ECS, EKS, Athena, Redshift, Glue, and Step Functions. - Experience with data warehouses or lakehouses (e.g., Snowflake, Databricks Delta Lake). - Experience with graph databases and knowledge graph schemas. - Experience with Docker and Kubernetes for running distributed jobs/services. - Experience with workflow managers (Airflow, Prefect, dbt, or similar). Benefits - Medical, dental, and vision insurance. - 401(k) plan. - Responsible vacation time (PTO). - Travel required for team/department offsites. - A Broadband internet connection required.

United States
$145K - $220K / year
American Heart Association logo

Data Warehouse Developer

American Heart Association

Headquartered in Dallas, Texas, the American Heart Association is one of the nation's largest, most successful nonprofit organizations. Once known as the Association for the Preven

Data Engineer3 days ago

Role Description The American Heart Association has an excellent opportunity for a Data Warehouse Developer! This position can be home-based. This is a full-time, benefits-eligible, grant-funded opportunity. Current funding will expire 12/31/2030 with the possibility of extension. The Association offers many resources to help you maintain work-life harmonization through your changing needs and life situations. To help you be successful, you will have access to Heart U, our award-winning corporate university, as well as additional training and support, locally. Responsibilities include: - Designing integration architectures, defining clinical data mappings from electronic health record data, developing data models, and consulting with the infrastructure team on server and data storage services. - Formulating and recommending standards for achieving maximum performance, compliance, and efficiency of the database and delivery to researchers in the AHA Precision Medicine Platform. - Working as part of a dynamic team of biomedical researchers, database designers, data scientists, statisticians, software developers, quality research and health IT team members, and clinical data experts to support the data pipeline, database management, and creation of new tools. - Supporting the team in the delivery of external grants by providing data science expertise. - Encouraging cross-department connections including the development and maintenance of standard operating procedures. - Ensuring accuracy and integrity of service-oriented architecture through analysis, coding, writing clear documentation, and problem resolution. - Maintaining in-depth current knowledge of standards, guidelines, and industry trends for Data Warehouse Architecture as it relates to reporting and operations. - Evaluating new data sources for adherence to the organization's quality standards and ease of integration. - Fostering use of self-service analytics, data governance, and visual discovery while guiding changes and limited reliance on manual data processes. - Building proof of concept and tangible results by sharing testing data. - Championing data quality, integrity, and reliability throughout the department by designing data flow models and promoting development best practices. - Helping with the assessment of database performance and the identification of problem areas by holding regularly scheduled reviews of code and monitoring software. - Performing other duties as required or assigned which are reasonably within the scope and responsibility of the job level and family. Qualifications - Bachelor's Degree or equivalent work experience. - Minimum of three (3) years of Data Mapping and Extract/Transform/Load (ETL) design and development experience with clinical electronic health record data. - Experience with data modeling and integration of architecture design and implementation with electronic health records. - Experience with Data Virtualization tools. - Comprehensive knowledge in software development lifecycles/methodologies, i.e. agile. - Strong presentation and collaboration skills and can communicate all aspects of the job requirements, including the creation of formal documentation. - Fluent in relational database concepts and flat file processing concepts. - Strong problem solving, time management, and organizational skills. Requirements - Experience with Electronic health records and image mapping. - Experience with Python, R, SQL. - Experience with Cloud offerings. - Experience with Amazon Web Services: S3, Glue, SageMaker, Lake Formation, Lambda, Athena, RedShift, EMR, etc. - ETL Technology: AWS Glue, SSIS, DataStage, Informatica. - Time series analysis, clustering, decision trees, and neural networks. - Database/Data Virtualization Technology: Snowflake, Apache Spark, Databricks, Hadoop, Cloudera, SQL Server, Oracle, Alteryx, Denodo. - Business Intelligence Technology: SSRS, Power BI, Tableau, MicroStrategy. Benefits - The expected pay range will be $95,000 - $115,000. Pay is commensurate with experience; geographic differentials to the pay range may apply. - Performance and Recognition: You are rewarded for achieving success through annual salary planning and incentive programs; eligibility for an incentive program is based on the type of position. - Benefits: We offer a wide array of benefits including medical, dental, vision, disability, and life insurance, along with a robust retirement program that includes an employer match and automatic contribution. - Professional Development: You can join one of our many Employee Resource Groups (ERG) or be a mentor/mentee in our professional mentoring program. - Work-Life Harmonization: The Association offers Paid Time Off (PTO) at a minimum of 16 days per year for new employees. - Tuition Assistance: We support the career development of all employees.

United States
$95K - $115K / year