Senior Backend Engineer, Infrastructure

Location

United States

Posted

75 days ago

Salary

$175K - $250K / year

Seniority

Senior

Job Description

Senior Backend Engineer, Infrastructure

Ellipsis Health

Role Description Ellipsis Health is developing cutting-edge AI/ML products to address healthcare staffing issues and administrative burdens. The platform employs conversational AI and patented vocal biomarker technology to deliver improved healthcare experiences for clients and patients. The team is headquartered in Silicon Valley and is funded and supported by preeminent venture capital groups and healthcare institutions. The organization is open to remote candidates for this role. - Expand and maintain our real-time voice pipeline: design, implement, and maintain Python micro-services for conversational AI orchestration—audio capture, streaming transcription, prompt/LLM logic, synthesis, and playback. - Integrate new providers & transports: add plug-ins for emerging ASR, TTS, LLM, and memory services; wire up WebRTC, SIP, or phone endpoints; build adapters that allow hot-swapping components without downtime. Build API endpoints. - Deliver ultra-low latency (<500 ms round-trip): profile async pipelines (asyncio, FastAPI, gRPC), optimize buffering, concurrency, and back-pressure handling. - Instrument & observe every hop: emit structured traces (OpenTelemetry), metrics, and logs for each pipeline stage; define SLOs for first-token latency, end-to-end latency, and streaming reliability. - Harden for production: implement graceful retries, idempotent message passing, circuit breakers, and HIPAA-compliant security (encryption in transit, per-tenant isolation, secrets rotation). - Collaborate cross-functionally with ML, product, data engineering, and client-SDK teams to deliver features such as voice cloning, multimodal hand-offs, and domain-specific memory retrieval. Qualifications - 4+ years building production back-ends in modern Python. - Proven experience with real-time streaming systems—WebRTC, WebSockets, or gRPC streaming—and proficiency with asyncio, FastAPI, or similar async frameworks. - Deep understanding of concurrency, buffering, audio codecs (Opus, PCM), and distributed tracing. - Solid understanding of AWS/GCP/Azure, including container orchestration (Kubernetes/EKS/GKE), message queues (Kafka/SQS/Pub/Sub), and IaC (Terraform). - Solid grasp of relational (PostgreSQL) and in-memory (Redis) data stores; able to model and persist conversational state. - Excellent communication skills and a bias for measured, observable, and continuously deployable software. Requirements - B.S./M.S. in CS, EE, or related fields (Bonus Points). - Familiarity with voice-agent frameworks (Bonus Points). - Hands-on with telephony (Twilio, Telnyx), SIP, or PSTN integrations (Bonus Points). - Experience integrating multimodal inputs (vision, text chat) into voice agents (Bonus Points). - Familiarity with GPU inference and streaming pipelines (Bonus Points). - Prior work in regulated industries (healthcare, finance) and comfort preparing for SOC 2 / HIPAA audits (Bonus Points). Benefits - Competitive salary and benefits. - 401k matching up to a certain percentage of your salary. - Health, vision, and dental insurance. - Very flexible paid time off. - The typical salary range for this role is $175,000 to $250,000 USD.

Related Categories

Related Job Pages

More Infrastructure Engineer Jobs

Instacart logo

Senior Security Engineer, Infrastructure

Instacart

Founded in 2012, Instacart offers on-demand food and grocery delivery across the United States. Named the #1 Most Promising Company in America by Forbes magazin

• Identify business-critical risks present within Instacart’s product and infrastructure. • Analyze the risks and define remediation strategies with actionable roadmaps. • Develop scalable systems to enable and encourage secure engineering patterns. • Own and drive systemic improvements across engineering and other functions. • Coach and mentor other engineers within the organization.

California + 18 moreAll locations: California | Colorado | Connecticut | District Of Columbia | Hawaii | Illinois | Maine | New Hampshire | New Jersey | New York | Oregon | Maryland | Massachusetts | Pennsylvania | Rhode Island | Texas | Vermont | Virginia | Washington
$192K - $242K / year
Instacart logo

Senior Security Engineer, Infrastructure

Instacart

Founded in 2012, Instacart offers on-demand food and grocery delivery across the United States. Named the #1 Most Promising Company in America by Forbes magazin

• Identify business-critical risks present within Instacart’s product and infrastructure. • Analyze the risks and define remediation strategies with actionable roadmaps. • Develop scalable systems to enable and encourage secure engineering patterns. • Own and drive systemic improvements across engineering and other functions. • Coach and mentor other engineers within the organization.

Canada
$196K - $207K / year
Job Closed
GCI Communication Corp logo

Senior Manager, Cloud Infrastructure & Orchestration

GCI Communication Corp

At GCI, we foster an environment where the unique perspectives of our employees, customers, and fellow Alaskans are celebrated. We add value to our community by nurturing and empowering each member of our workforce, ensuring equal opportunities for every Trailblazer. GCI is an equal opportunity employer. Qualified applicants are considered for employment without regard to race, color, religion, national origin, age, sex, sexual orientation, gender identity, marital status, mental or physical disability, veteran status, or any other status or classification protected under applicable state or federal law.

Full TimeRemoteTeam 1,001-5,000

Role Description GCI's Mgr Sr, Cloud Infrastructure & Orchestration will lead a team of engineers that provide critical cloud services for the Enterprise Cloud Platform (ECP), ensuring smooth operation, optimal performance, and security while maintaining business continuity and efficiency across the cloud environment. Manage the day-to-day operations and essential services of the ECP data centers and platform foundations, working with key stakeholders, internal support teams, and third-party suppliers to ensure optimal service delivery. Essential Duties and Responsibilities - Fully own the mission, goals, operations, and results of the team and areas of responsibility. - Provide strong leadership to span of control (direct and indirect reports); demonstrate effective leadership in all interactions companywide. - Establish the vision and tone for the department, consistent with company culture and mission. - Establish clear, measurable, and achievable goals and performance expectations and follow up appropriately. - Hire individuals who can accomplish those goals and meet those expectations; provide them the open communication, training, tools, and mentoring needed to be successful and develop professionally. - Provide clear and accurate feedback to individuals and teams on a timely and consistent basis. - Effectively manage processes including annual performance reviews, compensation adjustments, promotions, demotions, transfers, and disciplinary actions. Strategic Alignment - Monitor and maintain the health and performance of ECP data centers and platform foundations across multiple platforms. - Ensure ECP data centers and platform foundations adhere to relevant industry regulations and compliance standards. - Work with solution architects and technical product owners on capacity planning to develop asset lifecycle management plans. - Facilitate clear communication between team, stakeholders, and leadership. - Manage team capacity, assigning tasks based on individual skills and availability. - Continuously monitor cloud performance, cost management, and security compliance. - Manage incident response processes and escalate critical issues to appropriate teams. - Assist with forecasting future cloud resource needs and scaling infrastructure accordingly. Cloud Infrastructure & Services - Develop and maintain a resilient infrastructure to reduce failures. - Support applicable products and services with a focus on security and user experience. - Proactively identify, troubleshoot, and resolve issues to minimize downtime and impact on business operations. - Provide data center installation, configuration, and support of Compute, Storage, and Network assets. - Track key metrics to identify potential issues and optimize performance. - Ensure security procedures are in place to protect sensitive data stored in the cloud. - Maintain relationships with key business members and core vendors. - Provide senior-level support for escalated and complex data center and platform foundations issues. Team Development - Identify staff training needs and provide opportunities for relevant training programs. - Regularly assess the effectiveness of training programs and content. Qualifications - A combination of relevant work experience and/or education sufficient to perform the duties of the job may substitute to meet the total years required on a year-for-year basis. - High School diploma or equivalent. - Bachelor’s degree in Computer Science, Information Technology, or related field. - A minimum of ten (10) years of relevant professional experience in progressively responsible roles within a technology-related field. - Including at least three (3) years in a supervisory or management position. Requirements - Experience with cloud infrastructure (public and private), DevOps, or software development. - Telecommunications experience. - Vendor certifications (VMware, Cisco, F5, Aruba, etc.). - Cloud Infrastructure or Agile certifications. - Other relevant telecom industry or job specific certifications. Benefits - This position may require access to reliable transportation for occasional travel between retail store locations, offices, worksites, or other locations as needed. - Work is primarily sedentary, requiring daily routine computer usage. - Ability to work shifts as assigned, work in standard office/home office setting, and operate standard office equipment. - Must work well in a team environment and be able to work with a diverse group of people and customers.

United States
$102.7K - $170.4K / year
Job Closed
BitMEX logo

Senior Infrastructure Security Engineer

BitMEX

The Bitcoin Mercantile Exchange — BitMEX — is the world’s leading cryptocurrency derivatives trading platform. Launched in 2014 by ex-bankers well-versed in computer science, financial engineering, and traditional finance, BitMEX is now the single largest crypto exchange on Earth serving half a million customers across the globe.

Role Description As a Senior Infrastructure Security Engineer at BitMEX, you will play a critical role in securing our infrastructure and development lifecycles. You will drive the successful operation of our cybersecurity tool stack, maintain the security of our CI/CD pipelines, and continuously elevate our container security posture. Additionally, you will lead the deployment of Infrastructure-as-Code (IaC) security measures, integrating both automated and manual vulnerability testing processes to ensure robust protection across all environments. Key Responsibilities - Secure Automation & IaC: Design and implement secure automation solutions across development, testing, and production environments, leveraging Infrastructure-as-Code paradigms to maximize scalability and reliability. - Pipeline & Tooling Management: Implement, manage, and optimize security tooling for our infrastructure and CI/CD pipelines, enforcing strict configuration management and security best practices. - Strategic Collaboration: Partner closely with Product and Platform teams to actively shape and contribute to the Cloud Platform strategic roadmaps. - Technology Leadership & Innovation: Maintain extensive knowledge of advanced software principles and security architectures. Proactively identify long-term technologies of interest and propose strategic development initiatives to keep the organization ahead of the curve. - Industry Research: Continuously monitor the cybersecurity landscape and analyze cutting-edge industry trends, threats, and best practices to ensure our security posture remains modern and resilient. Qualifications - 8+ years of professional experience in the cybersecurity industry. - Deep expertise in security principles across infrastructure, applications, data layers, and integration points. - Demonstrated ability to architect, develop, and integrate enterprise security solutions within the Secure Software Development Lifecycle (SSDLC). - Track record of successfully managing complex, large-scale security projects from inception to completion. - Strong hands-on experience with public cloud primitives, containerization, and modern orchestration tools (e.g., Kubernetes, serverless architectures). - Proficiency with Infrastructure-as-Code (IaC) and configuration management (e.g., Terraform, Ansible). - Experience building and securing CI/CD pipelines, applying DevSecOps principles to tools like GitHub Actions and Helm. - Advanced end-to-end troubleshooting skills for complex distributed systems and security incidents. - Agile mindset with the ability to adapt quickly to evolving security threats and business priorities. - A proven passion for tackling complex technological challenges and driving innovative solutions. Preferred Qualifications - Industry-recognized security certifications (e.g., CISSP, CCSP, CCSK or GSEC). - Deep understanding of Public Key Infrastructure (PKI), including lifecycle management and cryptographic principles. - Technical expertise in Identity and Access Management (IAM) implementations and authentication protocols (e.g., SAML, OAuth, MFA, 2SV). - Hands-on experience with modern observability and telemetry stacks for monitoring and logging (e.g., OpenTelemetry, Prometheus). - Advanced proficiency with infrastructure templating languages and configuration tools (e.g., Helm Charts). Benefits - Work from home to help you find the perfect balance between work, family and personal life. - 25 days of annual leave, on top of public holidays, as well as maternity, paternity and childcare leave to accommodate your growing responsibilities. - A top tier & comprehensive medical, dental and vision policy for you and your dependents. - Professional development allowance to support your career advancement. - Access to our annual wellness benefits to cultivate your physical and mental growth. - Beyond Border Remote Working policy, where you get to work away from your home country. - Team building & offsite events to bring our global team closer. - Life insurance coverage to provide a safety net for your family’s future.

Worldwide
Job Closed