Defining what it means to build and deliver the most extraordinary sports & entertainment experiences.The Crown is Yours
Senior Data Engineer, Platform
Location
Massachusetts
Posted
7 days ago
Salary
$116.8K - $146K / year
Seniority
Senior
Job Description
Senior Data Engineer, Platform
DraftKings Inc.
• Demonstrate leadership and ownership of the platform to deliver services for projects and users. • Provide infrastructure guidance of data platform capabilities to accommodate business/technical use cases. • Leverage your strong communication skills to keep users informed and provide excellent quality of service. • Automate and manage provisioning needs, such as Snowflake storage and compute, Role Based Access Control model, and permissions. • Configure and manage monitoring/alerting around replication latency, performance (cluster & query), and Airflow. • Coordinate and collaborate with dependent infrastructure and AWS services to implement Snowflake integration with services, such as S3, IAM, SSO, etc. • Provide technical expertise, troubleshooting, and support for change management, governance compliance, internal audits, and remediations.
Job Requirements
- A proven track record of administration, engineering, and operationalizing the Snowflake, Databricks or similar Cloud Data Platform.
- Experience working in AWS, Terraform, CloudFormation, Python, and database replication tools/services (e.g., AWS DMS).
- Experience working with CI/CD pipelines and deployment automation
- Experience with a variety of data logging/monitoring tools, such as DataDog.
- Strong experience with SQL and knowledge in a variety of data engines (for example, SQL Server, MySQL, Amazon Aurora, Redshift) is a big plus.
- Experience writing software (preferably with Python).
Benefits
- Bonus
- Equity
- Benefits as applicable
Related Guides
Related Categories
Related Job Pages
More Platform Engineer Jobs
• Contribute to building and improving platform services, writing code, reviewing changes, and supporting deployments. • Work alongside senior engineers to design and implement solutions that improve scalability, reliability, and developer experience. • Help maintain and operate core systems such as CI/CD pipelines, cloud infrastructure, and monitoring. • Participate in incident response and retrospectives, contributing to learning and improvement. • Collaborate with other engineers to understand needs and translate them into practical platform solutions. • Take ownership of tasks and smaller projects, while developing towards owning larger areas of the platform.
Staff Platform Engineer
PostscriptSMS marketing platform for ecommerce companies. Helping Shopify stores drive 30x ROI with text message marketing.
• Own infra topology, scaling and blast-radius boundaries. • Build the validation gates, idempotency checks, drift detectors, and runbooks. • Diagnose novel failures such as consumer lag, DLQs, materialized-view chains. • Own the 500K events/sec target: load testing, tuning, Database sizing, SLOs and alerting. • Own IAM/IRSA, secret rotation, and the auth chain. • Keep skills, runbooks, and agent context in sync with reality. • Lead incidents and capture every fix as a new runbook plus regression test.
AI Platform Engineer
Bright Vision TechnologiesBright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.
Role Description We are seeking an AI Platform Engineer to design, build, and operate high-performance, highly reliable inference platforms for serving large machine learning models in production. The role focuses on the systems engineering side of AI deployment, including: - Request routing - Batching - Caching - Autoscaling - GPU utilization - End-to-end observability across diverse model workloads The ideal candidate brings strong distributed systems and performance engineering expertise, has shipped serving systems at scale, and understands the trade-offs between latency, throughput, cost, and quality in ML serving. Qualifications - Bachelor’s or Master’s degree in Computer Science or a related field. - Six or more years of experience in distributed systems, infrastructure, or ML platform engineering. - Strong proficiency in Python and a systems language such as Go, Rust, or C++. - Deep experience operating high-throughput, low-latency services in production. - Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM. - Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization. - Familiarity with Kubernetes, autoscaling, and modern cloud platforms. - Experience with observability stacks including metrics, tracing, and structured logging. - Solid grounding in performance engineering and capacity planning. - Strong communication and incident response skills. Requirements - Design and operate model serving platforms supporting diverse workloads including LLMs, vision models, and recommendation systems. - Optimize inference performance using continuous batching, paged attention, speculative decoding, and request multiplexing. - Implement multi-tenant routing, rate limiting, and quality-of-service policies across model endpoints. - Build autoscaling and capacity management systems that balance latency, throughput, and cost. - Tune GPU utilization, memory management, and KV cache strategies for LLM serving workloads. - Integrate model serving with API gateways, identity systems, and observability platforms. - Implement caching, prompt deduplication, and response reuse strategies where appropriate. - Drive end-to-end observability including latency histograms, queue dynamics, GPU utilization, and error tracking. - Develop deployment workflows including canary releases, shadow testing, and automated rollback. - Operate incident response for high-availability AI services and drive durable reliability improvements. - Collaborate with ML and product teams to support new model releases and capability rollouts. - Implement security controls including request signing, content filtering, and abuse detection at the serving layer. - Document operational procedures, performance characteristics, and tuning guidance for internal teams. - Stay current with AI serving research and translate advances into production capabilities. Preferred Qualifications - Open-source contributions to model serving infrastructure. - Experience with multi-region or globally distributed AI serving. - Familiarity with model quantization, distillation, and compression techniques. - Exposure to FinOps for AI workloads and cost-efficient serving design. - Experience supporting external-facing AI APIs at scale. How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com . Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Kafka Platform Engineer
Bright Vision TechnologiesBright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.
Role Description We are seeking an experienced Kafka Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads. In this role you will own the Kafka platform end-to-end, including: - Cluster sizing - Configuration - Security - Automation - Observability - Developer enablement The ideal candidate will combine deep Kafka internals knowledge with strong DevOps and SRE practices, and will partner with application teams to deliver a reliable, performant, and developer-friendly streaming platform. You will work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions. You will be expected to raise the bar through code review, design review, and mentorship of more junior engineers. The successful candidate brings strong engineering discipline, a clear communication style, and a track record of shipping meaningful work that holds up well in production. Qualifications - Bachelor’s degree in Computer Science, Engineering, or a related technical discipline. - Five or more years of experience operating Apache Kafka or Confluent Platform in production. - Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups). - Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC). - Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB. - Experience with HA/DR strategies for Kafka. - Strong scripting skills in Python, Bash, or Go. - Hands-on experience with infrastructure-as-code (Terraform, Ansible). - Working knowledge of observability tooling for Kafka. - Excellent troubleshooting, communication, and documentation skills. Requirements - Architect, deploy, and operate large-scale Apache Kafka or Confluent Platform clusters across on-prem and cloud environments. - Design partitioning, replication, and topic strategies that balance throughput, durability, and operational simplicity. - Implement strong security on Kafka clusters using SASL, mTLS, ACLs, RBAC, and integration with corporate IdPs. - Operate Schema Registry, Kafka Connect, KSQL/ksqlDB, and Kafka Streams in production. - Build and operate Kafka Connect pipelines integrating sources and sinks across enterprise systems. - Design HA/DR strategies for Kafka, including MirrorMaker 2, Cluster Linking, and multi-region active-active patterns. - Build CI/CD pipelines for Kafka topic, ACL, and connector configurations using GitOps patterns. - Implement comprehensive observability using Prometheus, Grafana, Datadog, or Confluent Control Center. - Drive Kafka cost and capacity optimization through right-sizing and storage tiering. - Onboard application teams to Kafka with clear patterns, templates, and best practices. - Lead incident response and post-incident reviews for streaming workloads, applying disciplined engineering practices and partnering closely with stakeholders to ensure outcomes are durable, well-documented, and aligned with broader team and platform standards. - Mentor and coach junior and mid-level engineers through code review, design review, pair programming, and structured knowledge sharing, helping the broader team grow in technical maturity and confidence over time. - Maintain comprehensive, current technical documentation — including architecture diagrams, design decisions, configuration references, runbooks, and operational procedures — so that the system remains supportable, auditable, and easy to onboard new engineers onto over time. - Continuously evaluate emerging streaming technologies (Pulsar, Redpanda, AWS MSK, Azure Event Hubs). Benefits - Competitive salary range: $100,000–$150,000 Annually - Full-time, Direct W2 position - 100% Remote (U.S.) How to Apply Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com . Equal Employment Opportunity (EEO) Statement Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall. BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.


