Principal Product Manager - AI Developer Tools & Inference Platforms

THE ROLE:

We're seeking a Principal Product Manager to manage and mentor a team of product managers responsible for the strategy, roadmap, and execution of AI and ML developer tools that power inference at scale on custom GPUs and heterogeneous hardware platforms. You'll drive innovation at the intersection of AI frameworks, SDK development, and hardware optimization. This role is a critical link between customers, engineering, and business stakeholders.

This is a high-impact role ideal for a technically fluent product leader passionate about shaping next-gen developer experiences, fostering cross-functional partnerships, and accelerating AI adoption across industries.

THE PERSON:

You're a strong communicator and systems thinker with a proven record of shipping AI/ML developer products and collaborating across engineering, marketing, and partner teams. You thrive in highly technical environments, are fluent in AI concepts (especially LLM inferencing at scale, either in clustered or cloud contexts), and possess a developer-first mindset. You have hands-on experience with software development, open-source contribution, or developer tools, and can bridge the gap between customer needs and product execution.

KEY RESPONSBILITIES:

• Write key product strategy documents and lead the roadmap for AI developer SDKs and tools, with a focus on LLM deployment, optimization, and scaling using accelerators (e.g., GPUs, custom silicon).

• Partner with engineering to drive feature prioritization, manage release cycles (e.g., monthly, nightly), and contribute to the product delivery lifecycle.

• Drive developer onboarding, usability, and documentation initiatives to improve Developer Experience.

• Serve as the voice of the developer by gathering and synthesizing feedback from customers, partners, and the community.

• Collaborate with industry partners (e.g., Hugging Face, PyTorch, Red Hat) on product integrations and ecosystem growth.

• Define, track, and periodically report on success metrics and KPIs of the team to showcase achievements and opportunities for improvement.

• Contribute to go-to-market (GTM) content including white papers, solution briefs, demos, release notes, and presentations.

• Mentor junior product managers and contribute to hiring decisions and team scaling.

• Represent the company and product at conferences, meetups, and workshops.

PREFERRED EXPERIENCE:

• Solid years of product management, with experience in managing PMs, with a focus on software products for developers or AI/ML workloads.

• Strong technical background in computer science, AI/ML, LLM inferencing, generative AI, or performance optimization for AI workloads.

• Experience with frameworks like PyTorch, TensorFlow, ONNX, or Triton

• Proven success collaborating with engineering on rapid release cadences (CI/CD, nightly builds, agile delivery).

• Comfortable reading and contributing to code (Python, C++, or similar) and using GitHub, JupyterLab, or AI coding tools like Copilot.

• Excellent stakeholder and partner management skills across internal teams and external organizations.

• Strong written communication, including technical documentation, product messaging, and community engagement.

EDUCATION:

• Bachelor's degree in Computer Science, or other Engineering focused degree.

#LI-EV1

#LI-HYBRID