Job Closed
This listing is no longer active.
From bits to atoms.
Distributed Training Engineer
Location
California
Posted
154 days ago
Salary
0
Seniority
Senior
Job Description
Distributed Training Engineer
Periodic Labs
• Optimize, operate and develop large-scale distributed LLM training systems • Work closely with researchers to bring up, debug, and maintain mid-training and reinforcement learning workflows • Build tools and directly support frontier-scale experiments • Contribute open-source large scale LLM training frameworks
Job Requirements
- Training on clusters with ≥5,000 GPUs
- 5D parallel LLM training
- Distributed training frameworks such as Megatron-LM, FSDP, DeepSpeed, TorchTitan
- Optimizing training throughput for large scale Mixture-of-Expert models
Related Guides
Related Categories
Related Job Pages
More Engineer Jobs
• Engage in requirements gathering and analyze business processes • Install, Integrate, Configure, and Deploy of IAM solutions • Develop and perform testing for IAM solutions • Provide knowledge transfer, training, and support as necessary • Maintain multiple environments following coding best practices and SDLC • Troubleshoot and maintain IAM solutions including product support • Remain current on IAM and IAM market trends, tools, methodologies, and best practices
• Own and deliver initiatives that have real business impact for a mission-critical product catalog platform. • Drive complex initiatives by breaking work into clear milestones and communicating progress, risks, and tradeoffs. • Influence platform strategy and data governance standards. • Partner closely with cross-functional teams to solve complex data problems with AI-driven use cases. • Work in a highly collaborative environment that values thoughtful system design and operational excellence. • Invest in the growth of your team by mentoring and coaching engineers.
• Partner with enterprise account executives and solution consultants during sales cycles to conduct business value assessments • Lead discovery sessions with customer executives and sale champions to understand business goals, pain points, and strategic initiatives • Quantify current state costs and future state benefits enabled by our solutions • Develop tailored ROI models, business cases, and total cost of ownership (TCO) analyses aligned to customer-specific data and industry benchmarks • Continuously refine and evolve reusable business value templates, tools and financial frameworks • Create and deliver compelling executive presentations and business case narratives • Translate technical and operational capabilities into business impact language for C-level stakeholders • Participate in executive briefings, QBRs, and customer advisory board sessions as needed • Support Customer Success and Strategic Accounts in validating realized value during onboarding and renewal cycles • Contribute to customer success stories, ROI proof points, and reference materials
• Verify AI-related sophisticated ASIC designs & features with formal verification methods. • Partner with architecture/RTL teams to specify properties, resolve deep design issues, and influence micro-architecture decisions. • Leverage and unleash the power of formal verification to rigorously verify critical design properties and ensure compliance with specifications, as well as minimize spec ambiguities. • Develop and implement advanced formal verification environments and methodologies for complex ASIC designs, including automated flows for scalability and efficiency. • Train and coach junior engineers on formal techniques and standard processes; Help on methodology/FAQ documentation.




