Senior/Staff/Principal Software Engineer – Observability Engineering
Location
New York
Posted
15 days ago
Salary
0
Seniority
Senior
Job Description
Senior/Staff/Principal Software Engineer – Observability Engineering
AppGate
• Own the end-to-end design and implementation of the AppGate observability fabric — from telemetry SDKs in our clients and gateways, to the LogForwarder pipeline, to customer-side integrations. • Make foundational technical decisions — transport protocols, sampling strategies, schema design, correlation models — that determine whether our platform scales gracefully to hundreds of millions of events per day. • Enable next-generation capabilities, including OpenTelemetry-Native Telemetry Fabric, High-Cardinality Data Pipeline, End-to-End Distributed Tracing, On-Demand Packet Capture, and more. • Define telemetry schema, correlation model, transport, and sampling strategies spanning client devices, controllers, and gateways. • Validate at Customer Scale: Test in lab environments matching our largest deployments and hunt down cardinality explosions and pipeline backpressure before customers see them. • Drive Integration Standards: Own the OTLP, Prometheus, and JSON-log compatibility surface and validate ingestion into Datadog, Splunk, Nexthink, and Elastic. • Collaborate Cross-Functionally: Work directly with product, R&D, and marquee customers in defense and critical infrastructure to shape requirements and deliver outcomes that matter.
Job Requirements
- 8+ years of engineering experience with at least 4 years dedicated to observability, telemetry, or large-scale data infrastructure (Datadog, Splunk, Elastic, Honeycomb, New Relic, Grafana Labs, or equivalent).
- Deep OpenTelemetry expertise: OTLP, the OTel Collector, semantic conventions, context propagation, and head/tail sampling — you can debate the trade-offs in your sleep.
- Distributed tracing in production: You’ve designed or significantly contributed to a tracing system handling real customer traffic, not just a side project.
- High-throughput pipeline experience: Hands-on with systems ingesting 100M+ events per day, including back-pressure handling, batching, and storage trade-offs.
- Strong systems programming: Production Go and/or Rust preferred. Comfort across the stack, from agent code to backend services.
- Networking and security fluency: Comfortable with TLS, DNS, TCP, and identity protocols. Prior ZTNA, SASE, or SD-WAN experience is a strong plus.
- Mindset: Pragmatic, opinionated, and impact driven. You know when to prototype and when to ship.
Related Guides
Related Job Pages
More Software Engineer Jobs
• Responsible for the engineering, orchestration, and transformation of data within the Salesforce Data Cloud ecosystem. • Technical hands-on role building integrations, pipelines, and high-volume data ingestion, connecting the Salesforce environment to external corporate platforms, with a strong focus on Databricks and relational databases.
• Work on the development, maintenance and evolution of systems in a mainframe environment, ensuring stability, performance and security for critical business applications. • Propose techniques and solutions to optimize processing time and improve the efficiency of high-end platform resource usage. • Develop and maintain COBOL systems (online and batch). • Provide production support and handle critical incidents. • Analyze requirements and propose technical solutions. • Ensure system stability and performance. • Participate in deployments and user acceptance testing (UAT). • Support testing and technical validations.
Software Engineer II
Quetzal International Services, SASWe are excited about the possibility of you joining our team! Apply now and take the next step in your career with Quetzal International Services, SAS!
Role Description Are you a developer who thrives on building scalable solutions and working with a cutting-edge web stack? At Quetzal International Services SAS, we are looking for a Software Engineer II to join our Technology & Engineering department. In this role, your technical ownership and commitment to best practices will be key. We are looking for someone who doesn't just write code but ensures it is robust, tested, and ready for scale. Qualifications - A minimum of 3 years in software engineering or development. - Bachelor’s degree in Computer Science, Software Engineering, or a related field. - English level B1 or higher and the ability to explain technical concepts to non-technical stakeholders. - A problem-solving mindset and the ability to mentor junior developers. Requirements - Deep experience and passion for CI/CD pipelines. - Commitment to thorough testing to ensure bug-free functionality. - Proven experience developing with Node.js, Nest.js, and front-end frameworks like Nuxt, Vue, or React. - Proficiency in database management using SQL. - Expert use of Git (GitHub/Azure) for source code and branch management. - Strong knowledge of SOLID and DRY principles. - Experience using AI-assisted coding tools (e.g., Claude Code) to optimize your workflow is highly valued. Benefits - Full-time, indefinite contract (Contrato a término indefinido) with all legal benefits. - Prepaid medical care for you and your qualified dependents. - Full dental coverage. - Life Insurance policy included. - Generous Paid Time Off (PTO) after three months to ensure you stay energized. Company Description You will work in a fast-paced environment that prioritizes continuous learning and industry trends. You will report to a Software Engineer Team Lead within a structured hierarchy designed for professional growth.
• You will be responsible for hiring additional engineers to fill out the team, with a focus on diversity and inclusion, and staffing and structuring your team to meet business needs. • Manage your team and help them to deliver high-quality software in a fast-paced, agile, high-growth environment. • Make technology, infrastructure, architectural, and hiring decisions to meet anticipated demands and scale. • Evaluate trade-offs and effectively prioritize tasks within each team in alignment with strategic initiatives and company goals. • Collaborate closely with product, design, editorial, data science, and marketing teams to define strategy and execute on roadmaps. • Brainstorm new product ideas and improvements alongside the design and product teams while also delivering clean, performant code (this role has an expectation of staying close to the codebase). • Hold regular 1:1s, evaluate performance, and provide consistent productive feedback. • Help engineers learn the skills needed to advance in their career. • Work with engineers and product managers to iterate on and improve team processes and efficiency. • Contribute to important company-wide initiatives like diversity and inclusion, technical brand, and hiring process.



