Persona logo
Persona

Configurable identity infrastructure for KYC, AML, KYB, fraud detection, onboarding, and more.

Software Engineer, Data Platform

Platform EngineerPlatform EngineerFull TimeRemoteSeniorTeam 51-200Since 2018H1B SponsorCompany SiteLinkedIn

Location

California

Posted

4 days ago

Salary

$130K - $220K / year

Seniority

Senior

Job Description

Software Engineer, Data Platform

Persona

• Build and scale our datalake • Develop high-throughput data-movement and ingestion services • Own streaming and batch ingestion and the change-data-capture pipelines • Build new query and analytics capabilities directly on the datalake • Operate the low-latency serving layer for real-time, high-concurrency access to platform data • Partner with infrastructure and product teams to provision, secure, and scale the platform

Job Requirements

  • 3+ years of experience in software engineering, with a focus on data infrastructure or large-scale distributed systems
  • Proficiency in Python
  • Excitement to ramp into Go
  • Hands-on experience with big-data or streaming technologies such as Spark, Kafka, or Flink
  • Experience building and operating scalable data pipelines across structured and unstructured data
  • Strong fundamentals in distributed systems, storage, and performance/cost optimization
  • Excellent communication and collaboration skills across engineering, data science, and infrastructure teams
  • Nice to have: ClickHouse, DuckDB, Google Cloud (GCP), Kubernetes, MySQL, MongoDB, Snowflake

Benefits

  • medical, dental, and vision
  • 3% 401(k) contribution
  • unlimited PTO
  • quarterly mental health days
  • family planning benefits
  • professional development stipend
  • wellness benefits
  • private medical insurance (for UK employees)
  • dental insurance (for UK employees)
  • 6% employer pension contribution (for UK employees)
  • monthly wellness stipend (for UK employees)
  • co-working stipend (for UK employees)

Related Categories

Related Job Pages

More Platform Engineer Jobs

Truelogic Software logo

Senior Data Engineer – Veterinary Technology

Truelogic Software

Premium boutique software development company that helps brands with big ideas to make a difference in people’s lives.

Full TimeRemoteTeam 501-1,000Since 2004H1B No Sponsor

• Take end-to-end ownership of the data platform's reliability, encompassing pipelines, warehousing, transformations, and observability. • Design, build, and maintain robust data pipelines using Apache Airflow, orchestrating complex workflows across batch and near-real-time workloads. • Manage and optimize the primary Snowflake data warehouse, handling schema design, clustering keys, materialized views, access controls, and strict cost governance. • Build and maintain the dbt transformation layer, including model design, incremental strategies, dependency management, and documentation. • Deploy and operate data platform services on Kubernetes (EKS), independently managing workloads, debugging pod issues, and tuning resource requests. • Provision and manage data platform infrastructure, including Snowflake resources and Airflow, utilizing Terraform. • Write high-quality SQL and Python for ETL tooling, pipeline logic, and data product delivery. • Manage PostgreSQL as a source-of-truth operational database, focusing on query optimization, indexing, replication, and migrations. • Lead the transition toward change data capture (CDC) for data ingestion, utilizing tools like Debezium to stream database changes. • Implement comprehensive observability, SLA tracking, and alerting across the data platform using Datadog. • Maintain CI/CD pipelines for DAG deployments, dbt runs, schema migrations, and container image builds. • Collaborate with analytics, product, and full-stack development teams to model clean, well-documented data products. • Navigate AWS environments (including RDS and S3) to manage data-adjacent services, read logs, and adjust scaling parameters.

Mexico
Truelogic Software logo

Senior Data & Platform Engineer – Veterinary Technology

Truelogic Software

Premium boutique software development company that helps brands with big ideas to make a difference in people’s lives.

Full TimeRemoteTeam 501-1,000Since 2004H1B No Sponsor

• Take end-to-end ownership of the data platform's reliability, encompassing pipelines, warehousing, transformations, and observability. • Design, build, and maintain robust data pipelines using Apache Airflow, orchestrating complex workflows across batch and near-real-time workloads. • Manage and optimize the primary Snowflake data warehouse, handling schema design, clustering keys, materialized views, access controls, and strict cost governance. • Build and maintain the dbt transformation layer, including model design, incremental strategies, dependency management, and documentation. • Deploy and operate data platform services on Kubernetes (EKS), independently managing workloads, debugging pod issues, and tuning resource requests. • Provision and manage data platform infrastructure, including Snowflake resources and Airflow, utilizing Terraform. • Write high-quality SQL and Python for ETL tooling, pipeline logic, and data product delivery. • Manage PostgreSQL as a source-of-truth operational database, focusing on query optimization, indexing, replication, and migrations. • Lead the transition toward change data capture (CDC) for data ingestion, utilizing tools like Debezium to stream database changes. • Implement comprehensive observability, SLA tracking, and alerting across the data platform using Datadog. • Maintain CI/CD pipelines for DAG deployments, dbt runs, schema migrations, and container image builds. • Collaborate with analytics, product, and full-stack development teams to model clean, well-documented data products. • Navigate AWS environments (including RDS and S3) to manage data-adjacent services, read logs, and adjust scaling parameters.

Colombia
Truelogic Software logo

Senior Data & Platform Engineer – Veterinary Technology

Truelogic Software

Premium boutique software development company that helps brands with big ideas to make a difference in people’s lives.

Full TimeRemoteTeam 501-1,000Since 2004H1B No Sponsor

• Take end-to-end ownership of the data platform's reliability, encompassing pipelines, warehousing, transformations, and observability. • Design, build, and maintain robust data pipelines using Apache Airflow, orchestrating complex workflows across batch and near-real-time workloads. • Manage and optimize the primary Snowflake data warehouse, handling schema design, clustering keys, materialized views, access controls, and strict cost governance. • Build and maintain the dbt transformation layer, including model design, incremental strategies, dependency management, and documentation. • Deploy and operate data platform services on Kubernetes (EKS), independently managing workloads, debugging pod issues, and tuning resource requests. • Provision and manage data platform infrastructure, including Snowflake resources and Airflow, utilizing Terraform. • Write high-quality SQL and Python for ETL tooling, pipeline logic, and data product delivery. • Manage PostgreSQL as a source-of-truth operational database, focusing on query optimization, indexing, replication, and migrations. • Lead the transition toward change data capture (CDC) for data ingestion, utilizing tools like Debezium to stream database changes. • Implement comprehensive observability, SLA tracking, and alerting across the data platform using Datadog. • Maintain CI/CD pipelines for DAG deployments, dbt runs, schema migrations, and container image builds. • Collaborate with analytics, product, and full-stack development teams to model clean, well-documented data products. • Navigate AWS environments (including RDS and S3) to manage data-adjacent services, read logs, and adjust scaling parameters.

Brazil
Truelogic Software logo

Senior Data & Platform Engineer – Veterinary Technology

Truelogic Software

Premium boutique software development company that helps brands with big ideas to make a difference in people’s lives.

Full TimeRemoteTeam 501-1,000Since 2004H1B No Sponsor

• Take end-to-end ownership of the data platform's reliability, encompassing pipelines, warehousing, transformations, and observability. • Design, build, and maintain robust data pipelines using Apache Airflow, orchestrating complex workflows across batch and near-real-time workloads. • Manage and optimize the primary Snowflake data warehouse, handling schema design, clustering keys, materialized views, access controls, and strict cost governance. • Build and maintain the dbt transformation layer, including model design, incremental strategies, dependency management, and documentation. • Deploy and operate data platform services on Kubernetes (EKS), independently managing workloads, debugging pod issues, and tuning resource requests. • Provision and manage data platform infrastructure, including Snowflake resources and Airflow, utilizing Terraform. • Write high-quality SQL and Python for ETL tooling, pipeline logic, and data product delivery. • Manage PostgreSQL as a source-of-truth operational database, focusing on query optimization, indexing, replication, and migrations. • Lead the transition toward change data capture (CDC) for data ingestion, utilizing tools like Debezium to stream database changes. • Implement comprehensive observability, SLA tracking, and alerting across the data platform using Datadog. • Maintain CI/CD pipelines for DAG deployments, dbt runs, schema migrations, and container image builds. • Collaborate with analytics, product, and full-stack development teams to model clean, well-documented data products. • Navigate AWS environments (including RDS and S3) to manage data-adjacent services, read logs, and adjust scaling parameters.

Argentina