Role Overview for VP, AI/ML Engineering with a Public Technology Firm – San Jose, CA
JRG Partners is proud to represent a premier, publicly-traded technology company based in the heart of Silicon Valley. We are seeking a visionary and transformative leader to join their executive team as the Vice President of Artificial Intelligence and Machine Learning (AI/ML) Engineering. This is a career-defining opportunity to helm the AI/ML division of a globally recognized organization, shaping the future of intelligent products and services that impact millions of users worldwide.
The ideal candidate is a seasoned technology executive with a profound understanding of the AI/ML landscape, from foundational research to scalable, production-ready systems. You will be responsible for setting the strategic direction, driving innovation, and leading a world-class organization of engineers, data scientists, and researchers. This role requires a unique blend of deep technical expertise, strategic business acumen, and inspirational leadership. You will be the central force driving the company’s AI-first initiatives, ensuring that we not only keep pace with the rapidly evolving industry but also define new frontiers.
As the VP of AI/ML Engineering, you will report directly to the Chief Technology Officer (CTO) and work in close collaboration with leaders across Product, Design, and Business units. Your mission will be to infuse artificial intelligence and machine learning into the core of our product portfolio, creating unparalleled user experiences, optimizing business operations, and unlocking new revenue streams. You will be entrusted with building and scaling our AI infrastructure, fostering a culture of relentless innovation, and mentoring the next generation of AI leaders within the company. If you are passionate about solving complex problems at scale and building intelligent systems that make a tangible difference, we invite you to apply for this pivotal role.
Key Responsibilities of VP, AI/ML Engineering with a Public Technology Firm – San Jose, CA
The VP of AI/ML Engineering will have a broad and impactful set of responsibilities, spanning strategic leadership, technical execution, and organizational development.
Strategic & Visionary Leadership
- Define and articulate the company-wide AI/ML vision, strategy, and roadmap, ensuring alignment with overall business objectives and long-term growth.
- Act as the company’s foremost expert and evangelist for AI/ML, both internally and externally, representing the company at industry conferences, in publications, and with key partners.
- Identify and champion new opportunities to leverage AI/ML for product innovation, operational efficiency, and competitive differentiation.
- Conduct in-depth analysis of emerging technologies and research trends, including advancements in areas like large language models (LLMs), generative AI, and transformer models, to inform strategic investments and technological direction.
- Oversee the AI/ML budget, including resource allocation, technology investments, and vendor relationships, ensuring optimal ROI.
Technical Execution & Innovation
- Lead the end-to-end lifecycle of AI/ML projects, from ideation and research to model development, deployment, and continuous monitoring and improvement.
- Establish and enforce best practices for MLOps, data governance, model validation, and ethical AI development to ensure our systems are robust, scalable, fair, and transparent.
- Architect and scale a state-of-the-art AI/ML infrastructure, including data pipelines, feature stores, training platforms, and inference engines, on modern cloud platforms (AWS, GCP, Azure).
- Drive a culture of experimentation and data-driven decision-making, fostering rapid prototyping and iterative development cycles.
- Ensure the highest standards of code quality, system reliability, and performance for all AI/ML services and applications.
Team Leadership & Organizational Development
- Lead, mentor, and grow a high-performing, globally distributed organization of AI/ML engineers, research scientists, and data scientists.
- Attract, hire, and retain top-tier talent in a highly competitive market, building a diverse and inclusive team environment.
- Foster a culture of collaboration, intellectual curiosity, and continuous learning, providing career development paths and growth opportunities for team members.
- Implement effective organizational structures and processes to optimize for velocity, innovation, and cross-functional alignment.
- Set clear goals and performance expectations for the team, providing regular feedback and coaching to cultivate leadership at all levels.
Cross-Functional Collaboration
- Partner closely with the Chief Product Officer to define product roadmaps that are deeply integrated with AI/ML capabilities.
- Collaborate with business leaders to understand key challenges and identify opportunities where AI/ML can drive significant business value.
- Work with legal and compliance teams to navigate the complex regulatory landscape of AI and ensure our practices are ethical and responsible.
- Communicate complex technical concepts and strategic plans effectively to a wide range of audiences, from the Board of Directors to individual contributors.
Requirements for the VP, AI/ML Engineering with a Public Technology Firm – San Jose, CA
We are seeking a candidate with a proven track record of leadership and technical excellence in the field of AI and Machine Learning.
Required Qualifications
Experience
15+ years of experience in software engineering, with at least 10 years focused on AI/ML, and a minimum of 7 years in a senior leadership role (Director, Sr. Director, or VP) managing large, high-performing engineering teams.
Education
Master’s degree or PhD in Computer Science, Artificial Intelligence, Machine Learning, Statistics, or a related quantitative field.
Technical Depth
Expert-level knowledge of modern machine learning algorithms, including deep learning (CNNs, RNNs, Transformers), reinforcement learning, and classical ML models. Hands-on experience with major ML frameworks such as TensorFlow, PyTorch, and scikit-learn.
Systems Design
Proven experience designing, building, and operating large-scale, distributed AI/ML systems in a production environment. Deep understanding of MLOps principles and tools (e.g., Kubeflow, MLflow, Seldon).
Leadership
Demonstrated ability to build and lead world-class technical teams, with experience managing managers and setting organizational strategy. A history of successfully recruiting and retaining top AI/ML talent.
Business Acumen
Strong ability to connect deep technical concepts to business outcomes. Experience developing and executing a technology roadmap that delivers measurable business impact.
Communication
Exceptional verbal and written communication skills, with the ability to influence and inspire at all levels of the organization, from the executive suite to junior engineers.
Preferred Qualifications
- Experience working in a large, publicly-traded technology company.
- A track record of publications in top-tier AI/ML conferences (e.g., NeurIPS, ICML, CVPR) or significant contributions to open-source AI/ML projects.
- Deep domain expertise in one or more areas such as Natural Language Processing (NLP), Computer Vision, Recommender Systems, or Search.
- Experience managing globally distributed teams and working across different time zones.
- Familiarity with data privacy and security regulations (e.g., GDPR, CCPA) as they pertain to AI/ML systems.
Benefits & Perks Offered
Our client offers a comprehensive and competitive benefits package designed to support the well-being and professional growth of their employees and their families. As a senior executive, you will be eligible for:
Competitive Compensation
A highly attractive base salary, annual performance-based bonus, and a significant equity package (RSUs) that vests over time.
Comprehensive Health Coverage
Premier medical, dental, and vision insurance plans for you and your dependents with low employee contributions.
Retirement Planning
A robust 401(k) plan with a generous company match to help you save for your future.
Work-Life Balance
A generous paid time off (PTO) policy, paid company holidays, and flexible work arrangements.
Family Support
Comprehensive paid parental leave for all new parents, as well as fertility and adoption assistance programs.
Wellness Programs
A monthly wellness stipend, access to mental health resources, and on-site fitness facilities or subsidized gym memberships.
Professional Development
A substantial annual budget for conferences, training, certifications, and other professional growth opportunities.
Additional Perks
Commuter benefits, catered lunches, employee stock purchase plan (ESPP), and employee assistance programs.
How to Apply
This is an exclusive, retained search conducted by JRG Partners. To be considered for this confidential opportunity, please submit your resume and a cover letter detailing your qualifications and leadership philosophy. We are committed to a transparent and efficient interview process.
JRG Partners specializes in placing transformative leaders in high-growth technology companies. To learn more about our expertise in this domain, please visit JRG Partners’ Technology Executive Search practice. We look forward to reviewing your application and discussing how you can make a lasting impact in this pivotal role.

