Software Engineer - Infrastructure
Location
New York + 1 moreAll locations: New York | California
Posted
106 days ago
Salary
$150K - $230K / year
Seniority
Mid Level
Job Description
Software Engineer - Infrastructure
Baseten
ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE As an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance. EXAMPLE INITIATIVES You'll get to work on these types of projects as part of our Infrastructure team: Multi-cloud capacity management Inference on B200 GPUs Multi-node inference Fractional H100 GPUs for efficient model serving RESPONSIBILITIES Develop infrastructure components for our ML inference platform using Python and Go Implement and maintain Kubernetes deployments for model serving Contribute to our inference orchestration layer for model deployments Build and enhance monitoring systems for model performance metrics Implement efficient resource management solutions for ML workloads Support infrastructure automation to improve ML deployment workflows Work closely with team members to implement technical solutions Help balance performance optimization with system reliability Participate in technical discussions around infrastructure improvements Learn and apply infrastructure best practices REQUIREMENTS BENEFITS Competitive compensation, including meaningful equity. 100% coverage of medical, dental, and vision insurance for employee and dependents Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!) Paid parental leave Company-facilitated 401(k) Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities. Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you. At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
Job Requirements
- Bachelor's degree or higher in Computer Science or related field
- 1-3 years experience in software engineering or infrastructure
- Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus
- Working knowledge of Kubernetes and containerization
- Basic understanding of machine learning concepts and model serving
- Familiarity with distributed systems concepts
- Experience with basic monitoring and logging tools
- Interest in ML/AI infrastructure and willingness to learn
- Strong collaboration and communication skills
Related Guides
Related Job Pages
More Software Engineer Jobs
Mobile Software Engineer Intern (Summer 2026)
SquareSince we opened our doors in 2009, the world of commerce has evolved immensely, and so has Square. After enabling anyone to take payments and never miss a sale, we saw sellers stymied by disparate, outmoded products and tools that wouldn’t work together. So we expanded into software and started building integrated, omnichannel solutions – to help sellers sell online, manage inventory, offer buy now, pay later functionality through Afterpay, book appointments, engage loyal buyers, and hire and pay staff. Across it all, we’ve embedded financial services tools at the point of sale, so merchants can access a business loan and manage their cash flow in one place. Afterpay furthers our goal to provide omnichannel tools that unlock meaningful value and growth, enabling sellers to capture the next generation shopper, increase order sizes, and compete at a larger scale. Today, we are a partner to sellers of all sizes – large, enterprise-scale businesses with complex operations, sellers just starting, as well as merchants who began selling with Square and have grown larger over time. As our sellers grow, so do our solutions. There is a massive opportunity in front of us. We’re building a significant, meaningful, and lasting business, and we are helping sellers worldwide do the same.
Since we opened our doors in 2009, the world of commerce has evolved immensely, and so has Square. After enabling anyone to take payments and never miss a sale, we saw sellers stymied by disparate, outmoded products and tools that wouldn't work together. So we expanded into software and started building integrated, omnichannel solutions - to help sellers sell online, manage inventory, offer buy now, pay later functionality, book appointments, engage loyal buyers, and hire and pay staff. Across it all, we've embedded financial services tools at the point of sale, so merchants can access a business loan and manage their cash flow in one place. Afterpay furthers our goal to provide omnichannel tools that unlock meaningful value and growth, enabling sellers to capture the next generation shopper, increase order sizes, and compete at a larger scale. Today, we are a partner to sellers of all sizes - large, enterprise-scale businesses with complex operations, sellers just starting, as well as merchants who began selling with Square and have grown larger over time. As our sellers grow, so do our solutions. There is a massive opportunity in front of us. We're building a significant, meaningful, and lasting business, and we are helping sellers worldwide do the same. The Role Our mobile developers keep Block's products simple and make our users faster and smarter by delivering exceptional user experiences and rich data insights. We're looking for engineers of all shapes and sizes, who are excited about contributing to outstanding software and solving hard problems. Our challenges span many technologies, including iOS and Android mobile applications. As a mobile developer at Block, you will work on a small team with people across engineering, product, and creative to build products that serve millions of users across our ecosystem. You Will Collaborate with fellow mobile developers to develop, test, and release high quality apps for our users Ensure Block's products work right, every time, by using testing, continuous integration, and in-depth code reviews Create interactions and APIs that promote trust, increase security, and make it harder to do the wrong thing Contribute to the success of your team's projects and development Envision entire new products, features, and flows that are inspired, considered, and magical You Have Pursuing degree in Computer Science, Electrical Engineering, Math or related technical field, graduating between May 2027 and May 2030. We also consider recent bootcamp graduates and engineering training participants within three months of completing program/training requirements.
DevDocs is a fully remote company that hires developers to build documentation and docs tooling for clients like Qualcomm, American Express, and C3 AI. We don’t hire writers, and we don’t just crank out docs: our close-knit team is full of technical experts who can deeply understand a client’s products, consult on their problems, then design tools and systems to automate their docs processes (and write the most important docs). What you’ll do This role lives somewhere between engineer, teacher, and toolmaker. You’ll: Get dropped into new tech, figure it out fast, and make it make sense. Build tools and AI workflows to make every project smoother. Write docs that matter and figure out how to systematize them. Untangle messy knowledge structures and design something better. Ask detailed questions, get to the root of things, and make it simpler. Improve DevDocs itself - processes, tooling, weird experiments welcome. What we’re looking for You pick things up fast and figure stuff out without needing a map. You write like you talk: clearly and directly. You think like an engineer and enjoy solving puzzles. You’ve worked with clients or stakeholders and enjoy being social. You’ve built projects for fun - or because something annoyed you enough to fix it. Company culture Remote. U.S. timezone overlap, but otherwise flexible. No grind. 40 hours/week. We actually mean it. Real ownership. You’ll ship work and see it used. Learning built-in. We carve out time and budget for it. Room to grow. Projects shift, ideas evolve, roles expand. If you want to stretch, we’ll make space. Requirements Benefits The fine print 1099 Contractor (Ongoing). Full-time (40hrs/week). $40-75/hr based on experience and qualifications. PTO, Holiday pay, & Sick Leave Raises are common after 6-12 months. Monthly learning stipend. Must be authorized to work in the U.S. or Canada. No sponsorship available.
Staff Software Engineer, GRC Products
VantaVanta is the leading trust management platform that helps simplify & centralize security for organizations of all sizes.
At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it. Our business has found incredible product-market fit and has monetized effectively since the day we signed our first customer. We’re growing at a blistering pace, which presents career-defining opportunities for engineers to accelerate their growth and to contribute to a rapidly-scaling company. Visit our Vanta Engineering Blog to learn more about what our team is working on! The GRC (Governance, Risk and Compliance) organization is the primary org responsible for developing and maintaining Vanta's core product offerings. These teams are at the heart of Vanta moving upmarket to support enterprise customers and build products that enable our customers’ existing security and compliance programs to integrate seamlessly with Vanta, giving them invaluable insights and recommendations to continue to operate, mature and evolve their programs. As a Staff Software Engineer at Vanta, you will play a critical role in driving the long-term technical strategy, leading complex initiatives, and making high-impact decisions that affect your product area and the broader engineering organization. You will set the tone for engineering excellence and culture. This role involves a mix of hands-on development, leadership, strategic thinking, and cross-functional collaboration. You will work closely with engineering leadership and product teams to ensure the alignment of systems with Vanta’s technical strategy, and you will actively influence key decisions across the organization. What you’ll do as a Staff Software Engineer at Vanta: Identify, scope, and lead large technical projects, laying the groundwork for building highly performant, reliable, and customizable systems with long-term impact. Drive a portfolio of complex initiatives with a duration spanning multiple quarters, ensuring iterative and sustainable impact across product areas. Rally cross-functional teams to drive initiatives to completion, even without direct management of team members. Make strategic decisions that prioritize long-term success, while influencing Vanta’s technical direction alongside senior engineers and leadership. Champion engineering excellence by continuously improving processes, methodologies, and technical practices across the organization. Guide teams on tough technical decisions, balancing tradeoffs and resolving conflicts. Address product, technical, and operational challenges with clear, impactful solutions. Serve as a cultural leader, modeling collaborative behaviors and mentoring engineers to elevate organizational performance. How to be successful in this role: Over 10 years of industry experience with deep expertise in one or more technical areas (e.g., frontend, databases, distributed systems, APIs, AI, etc.). Proven ability to lead complex technical initiatives, driving strategic projects and improving organizational processes in fast-paced, dynamic environments. Mastery in system design and software architecture, with a strong ability to balance technical considerations and execution constraints. Extensive experience building user-facing SaaS products, catering to both startup and enterprise users. Expertise in building 0→1 products and solving large-scale challenges, especially in environments that prioritize a bias for action. Strong leadership and mentorship experience, consistently up-leveling teams and leading by example. Excellent communication skills with the ability to influence and advocate for technical decisions at all levels of the organization. Open to using AI to amplify their skills and strengthen their work - demonstrating curiosity, a willingness to learn, and sound judgment in applying AI responsibly to improve efficiency and impact. What you can expect as a Vanta'n: Industry-competitive salary and equity Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans 16 weeks fully-paid Parental Leave for all new parents Health & wellness stipend Remote workspace, internet, and cellphone stipend Commuter benefits for team members who report to the SF and NYC office Family planning benefits Matching 401(k) contribution with immediate vesting Flexible PTO policy, plus 80 hours of Sick Time 11 company-paid holidays Virtual team building activities, lunch and learns, and other company-wide events! Offices in SF, NYC, London, Dublin, Tel Aviv, and Sydney To provide greater transparency to candidates, we share base pay ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar-stage growth companies. Final offer amounts are determined by multiple factors and may vary based on candidate location, skills, depth of work experience, and relevant licenses/credentials. #LI-remote At Vanta, we are committed to hiring diverse talent of different backgrounds and as such, it is important to us to provide an inclusive work environment for all. We do not discriminate on the basis of race, gender identity, age, religion, sexual orientation, veteran or disability status, or any other protected class. As an equal opportunity employer, we encourage and welcome people of all backgrounds to apply. About Vanta We started in 2018, in the wake of several high-profile data breaches. Online security was only becoming more important, but we knew firsthand how hard it could be for fast-growing companies to invest the time and manpower it takes to build a solid security foundation. Vanta was inspired by a vision to restore trust in internet businesses by enabling companies to improve and prove their security. From our early days automating security monitoring for compliance standards like SOC 2, HIPAA and ISO 27001 to creating the world's leading Trust Management Platform, our vision remains unchanged. Now more than ever, making security continuous—not just a point-in-time check— is essential. Thousands of companies rely on Vanta to build, maintain and demonstrate their trust— all in a way that's real-time and transparent.
Staff Software Engineer (Java Libraries)
ChainguardMaking the software supply chain secure by default.
Staff Software Engineer, Java Libraries The role, in a nutshell: Imagine a Java ecosystem where builds are reproducible, dependencies are trustworthy, and the factory just hums. We’re hiring a Staff Software Engineer for Chainguard’s Libraries organization, focused on the Java ecosystem. You’ll contribute to the technical direction for our Java libraries factory: secure, reliable, automated build and packaging pipelines that produce high-quality Java artifacts for customers and internal teams. This is an infrastructure-focused role. You’ll build systems and tooling used by many engineers, directly supporting Chainguard Libraries, one of our major product lines. What you’ll do: Own architecture and direction for Java ecosystem infrastructure, enabling secure, reproducible build, test, and distribution workflows for Java libraries and SDKs. Design and maintain automation for building, updating, validating, and publishing Java artifacts, including vulnerability scanning, remediation, SBOMs, and provenance. Build internal developer tools (Gradle/Maven plugins, CLIs, code generators) that improve how we build and maintain Java packages at scale. Integrate deeply with Gradle and Maven and artifact repositories, solving complex dependency and module-resolution issues in large codebases and mono-repos. Collaborate with product and engineering leadership to shape the Java libraries roadmap and deliver on key business outcomes for Chainguard Libraries. Mentor and unblock other engineers through design reviews, documentation, and hands-on debugging of build and infrastructure issues. Partner with Platform, Delivery, Sustaining, and Security to ensure Java pipelines and services meet reliability and security expectations. What we’re looking for: if using AI, include the phrase “bonfires are my jam” Core experience 8+ years working in Java or similar ecosystems on build systems, packaging, or developer tooling, ideally on platform/infra or ecosystem teams. Proven experience building and owning Gradle/Maven plugins, CI/CD automation, or internal frameworks/tools for Java libraries or services. Deep familiarity with Gradle and Maven for building and packaging libraries (multi-module builds, dependency graphs/BOMs, publishing to registries). Strong background in orchestrating large codebases or mono-repos and fixing dependency and build failures in production environments. Comfortable working with infrastructure code and tooling (e.g., Go-based systems, Terraform, CI/CD), alongside deep Java expertise. Demonstrated ability to debug toolchain, compiler, and packaging issues at scale and drive them to resolution. Experience with cloud-native environments: containers (Docker/OCI, Kubernetes), public cloud (GCP, AWS, or Azure), and modern CI/CD systems (e.g., GitHub Actions, Argo, Tekton, or similar). Excellent communication in a remote, distributed setup. Comfortable working across product, infra, and security, and mentoring peers at senior levels. A staff-level ownership mindset: you define direction, own critical outcomes, and thrive in an early, high-impact area where engineers help set the roadmap. Nice to have Open source contributions in the Java ecosystem (libraries, build tools, packaging, or related infrastructure). Experience building and distributing widely used libraries, SDKs, or runtimes. Familiarity with software supply chain security: SLSA, SBOMs, sigstore, provenance, attestations. Prior work in SRE, platform engineering, or DevOps roles tied to Java, developer productivity, or CI/CD pipelines. Exposure to Linux distribution and packaging ecosystems or reproducible build systems (e.g., Alpine, Wolfi, Debian, Bazel, Nix). About Us Chainguard is the secure foundation for software development and deployment. By providing guarded open source software, built from source and updated continuously, Chainguard helps organizations eliminate threats in their software supply chains. Founded by the industry's leading experts on open source software, security and cloud native development, Chainguard has built the largest library of open source software that is secure by default. Chainguard’s mission is to be the safe source for open source. We live and breathe our company values: We are customer obsessed - We focus on delivering solutions to our customers that create value and make their lives better. We have a bias for intentional action - We prioritize, plan, try things, and fail fast. We don’t take ourselves too seriously (but we do serious work) - We are solving an important problem which takes focus, but we also like to enjoy the journey. We trust each other and assume good intentions - We’re transparent with decisions to empower team members to make well informed decisions. A few of the benefits we offer: Flexible & Remote-First Culture: Work remotely with team meetup opportunities, bi-annual destination summits, and a monthly stipend for coworking spaces, phone and internet costs. Our Approach to Equity: Receive stock options upon hire and promotion. Plus, you can participate in secondary offerings and have 10 years to exercise your options (yes, you read that correctly: 10 years!). 100% Covered Health Insurance: We cover 100% of your health, vision and dental insurance premiums for you and your dependents. Nothing comes out of your paycheck. ∞ Flexible Time Off: Take the time you need – to do our best work, we need to recharge and reset. 18 Weeks Paid Parental Leave: We offer 18 weeks for birthing parents and 12 weeks for non-birthing parents, with the option to use it all at once or throughout your child's first year. If your experience is close but doesn’t fulfill all requirements, please apply. We’re building the best team in technology and are focused on hiring “Chainguardians'' with unique backgrounds, perspectives, and experiences.



