To enable broadband service providers of all sizes to simplify, innovate and grow.
Staff Software Engineer – Cloud Platform, Kafka
Location
California
Posted
121 days ago
Salary
$136K - $265.7K / year
Seniority
Lead
Job Description
Staff Software Engineer – Cloud Platform, Kafka
Calix
• Design, provision, and manage Apache Kafka clusters (self-managed on GCP/AWS or via Confluent Platform / MSK). • Configure and tune brokers, ZooKeeper/KRaft, topics, partitions, replication factors, and retention policies for high throughput and low latency. • Perform cluster upgrades, rolling restarts, and broker replacements with zero downtime. • Implement and manage Kafka Connect pipelines for data ingestion and egress across heterogeneous systems. • Administer Kafka Streams and ksqlDB deployments for real-time stream processing workloads. • Maintain Schema Registry and enforce schema governance standards across teams. • Define and track SLIs/SLOs for consumer lag, throughput, end-to-end latency, and broker health. • Design and implement cloud infrastructure using IaC – Terraform • Build automated deployment pipelines for Kafka configuration changes using GitOps workflows (ArgoCD, Flux). • Create self-service tooling and runbooks to reduce toil for development teams. • Automate topic provisioning, ACL management, and schema registration via APIs and CLI tooling. • Integrate tools like GitLab CI/CD, or Cloud Build for automated testing and deployment. • Ensure seamless integration of data pipelines with other GCP services like Big Query, Cloud Storage. • Monitor and Optimize performance, reliability, and cost of Kafka and streaming pipelines • Implement security best practices for GCP resources, including IAM policies, encryption, and network security. • Ensure Observability is an integral part of the infrastructure platforms and provides adequate visibility about their health, utilization, and cost. • Collaborate extensively with cross functional teams to understand their requirements; educate them through documentation/trainings and improve the adoption of the platforms/tools.
Job Requirements
- 10+ years of overall experience in DevOps cloud engineering, or data engineering.
- 5+ years of experience in Kafka at production scale.
- Deep expertise in Kafka internals: replication protocol, log compaction, consumer group coordination, partition leadership, and KRaft mode
- Proficiency with container orchestration (Kubernetes / Helm) and deploying Kafka via Strimzi, Confluent Operator, or equivalent
- Strong understanding of networking (VPC, peering, private endpoints, DNS, load balancing) in cloud environments.
- Hands-on experience with Kafka Connect, Schema Registry, and at least one stream processing framework (Kafka Streams, Flink, Spark Structured Streaming).
- Proficiency in Google Cloud Platform (GCP) services, including Dataflow, Pub/Sub, Kafka, Dataproc, Big Query, and Cloud Storage.
- Expertise in Infrastructure as Code (IaC) tools like Terraform or Cloud Deployment Manager.
- Familiarity with data orchestration tools like Apache Airflow or Cloud Composer.
- Experience with CI/CD tools like Jenkins, GitLab CI/CD, or Cloud Build.
- Knowledge of containerization and orchestration tools like Docker and Kubernetes.
- Strong scripting skills for automation (e.g., Bash, Python).
- Experience with monitoring tools like Cloud Monitoring, Prometheus, and Grafana.
- Familiarity with logging tools like Cloud Logging or ELK Stack.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to work in a fast-paced, agile environment.
Benefits
- As a part of the total compensation package, this role may be eligible for a bonus.
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Full Stack Software Engineer
ArineArine optimizes medication to ensure each patient is on the safest, most effective therapy for their unique health needs
• Design, develop, test, and maintain scalable front-end and back-end components using modern frameworks. • Architect and implement robust, secure APIs and data integrations. • Lead code reviews, mentor junior developers, and contribute to the continuous improvement of engineering practices. • Collaborate cross-functionally with product, design, and operations teams to define and ship high-impact features. • Participate in sprint planning, retrospectives, and other agile ceremonies.
Software Architect
EnergyHubEnergyHub empowers utilities and their customers to create a clean, distributed energy future.
• Lead the strategic extraction into a distributed architecture • Apply Conway's Law and utilize the Inverse Conway Maneuver • Guide the creation of the internal developer platform • Build frameworks for knowledge transfer and decision-making • Act as a translator between the C-suite and engineering teams • Manage technical debt and translate architectural constraints
Senior Software Engineer
ComcastHeadquartered in Philadelphia, Pennsylvania, Comcast was established in 1963 as a single-system cable company. Over the years, Comcast experienced tremendous gr
Role Description FreeWheel is looking for passionate Software Engineers to help design, build and support our high-quality, innovative video advertising platform. This position is virtual based. FreeWheel helps the television industry to monetize their premium contents through a robust technology platform, which enables consumers to view high quality videos on any devices including PC, smart phone, OTT device, set-top box and traditional TV. FreeWheel’s New York Engineering Hub is a core part of our global engineering group that is building the one-stop solution for TV industry to manage its billion-dollar revenue. Our tech platform is capable of handling billions of daily requests, processing terabytes of raw daily data, and optimizing clients’ business. Core Responsibilities - Collaborates with project stakeholders to identify product and technical requirements. - Conducts analysis to determine integration needs. - Designs new software and web applications, supports applications under development and customizes current applications. - Assists with the software update process for existing applications and roll-outs of software releases. - Participates in training representatives and operations staff on internally developed software applications. - Researches, writes and edits documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals and formal recommendations and reports. - Monitors and evaluates competitive applications and products. - Reviews literature, patents and current practices relevant to the solution of assigned projects. - Provides technical leadership throughout the design process and guidance with regards to practices, procedures and techniques. - Serves as a guide and mentor for junior-level Software Development Engineers. - Works with Quality Assurance team to determine if applications fit specification and technical requirements. - Displays in-depth knowledge of engineering methodologies, concepts, skills and their application in the area of specified engineering specialty. - Displays in-depth knowledge of and ability to apply, process design and redesign skills. - Presents and defends architectural, design and technical choices to internal audiences. - Displays knowledge of and ability to apply project management skills. - Consistent exercise of independent judgment and discretion in matters of significance. - Regular, consistent and punctual attendance. - Must be able to work nights and weekends, variable schedule(s) and overtime as necessary. - Other duties and responsibilities as assigned. Qualifications - Bachelor's Degree or above. - 3 years or above relevant work experience. - Experience with C/C++, DB design, and network programming. - Experience with distributed system software design and mission-critical systems. - Familiar with Open RTB protocol is a plus. - Advertising industry experience is a plus. - Demonstrated in problem-solving and technical innovation. - Strong passion for learning/practicing new techniques. - Knowledgeable about SDLC, Agile and Software Engineering Methodology. - Ability to work closely with global teams and accept additional working times besides normal working hours to meet or co-work with global teams. Requirements - Employees at all levels are expected to understand our Operating Principles; make them the guidelines for how you do your job. - Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services. - Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences. - Win as a team - make big things happen by working together and being open to new ideas. - Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers. - Drive results and growth. - Support a culture of inclusion in how you work and lead. - Do what's right for each other, our customers, investors and our communities. Compensation - Primary Location Pay Range: $129,515.93 - $194,273.89. - This job can be performed in Denver Campus with a Pay Range of $129,515.93 - $203,525.03. - Comcast intends to offer the selected candidate base pay within this range, dependent on job-related, non-discriminatory factors such as experience. - Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. - Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. - Additionally, Comcast provides best-in-class Benefits to eligible employees. Education - Bachelor's Degree preferred. - Comcast may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience. Disclaimer This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Software Engineer – Optimizely CMS, Episerver
AbstraPersonalized solutions and expert guidance from your trusted nearshore partner.
• Support the full site setup within the client’s existing Optimizely instance. • Develop and maintain a reusable component library aligned with current page patterns and best practices. • Recreate all identified pages from the existing site, ensuring consistency and accuracy. • Build and maintain global site elements, including headers, footers, and CTA components. • Integrate and configure site search using Optimizely Find. • Develop the blog infrastructure for the Wellness & You section. • Implement SSO (Single Sign-On) integration for gated content within the Resources section. • Collaborate on the configuration of gated areas based on content structure and access rules. • Support content migration from the existing site to the new platform setup. • Participate in QA processes, ensuring quality, responsiveness, and performance. • Provide UAT (User Acceptance Testing) support and address feedback. • Assist with training, documentation, and deployment activities. • Work closely with client stakeholders, designers, and other developers. • Validate and confirm the use of existing tools (Optimizely Find, SSO configurations, etc.) within the client environment. • Align development with SEO best practices, analytics tracking, and cookie consent requirements.




