Agent Tuner

Job Description

McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you and those we serve - we care.

What you do at McKesson matters. We foster a culture where you can grow, make an impact, and are empowered to bring new ideas. Together, we thrive as we shape the future of health for patients, our communities, and our people. If you want to be part of tomorrow’s health today, we want to hear from you.

Role Summary
The Agent Tuner is accountable for what Sierra AI agents know and how they behave. This role tunes agent prompts, intents, conversation flows, and the knowledge they retrieve so that agents respond accurately, consistently, and in the McKesson voice across email, chat, and voice.
This is a hands-on operator role inside the Agentic Service Experience pillar. The Tuner adjusts the agent every day; reading transcripts, testing changes, curating the agent-facing knowledge base, and shipping iterations in partnership with Sierra and McKesson Technology. They translate the AI Agent Product Manager's prioritized backlog into actual agent behavior and translate quality findings from the AI Performance & Quality Analyst into prompt, flow, and knowledge changes.
This is a new role created as part of CxO's agentic service operating model and will help shape how agent tuning and knowledge curation scale through FY27 and beyond.

Key Responsibilities

AI Knowledge Authoring

- Author and structure prompt-aware content for AI agents. Write knowledge so agents respond accurately and empathetically without hallucinating. Decide where the agent needs no additional content, where it needs context, where it can pull data from upstream systems, and where it needs detailed instructions. Tailor knowledge accordingly.

- Incorporate knowledge from across NAPS. Pull domain expertise from SMEs across service delivery teams into the agent knowledge base so agents respond to real customer scenarios, not just documented ones.

- Author in the McKesson voice. Ensure agent responses are brand-aligned, empathetic, and appropriate for healthcare and pharmaceutical customers. Partner with brand, communications, and Responsible AI partners on tone and standards.

AI Information Architecture

- Ensure content is relevant, accurate, current, non-conflicting, and succinct. Identify gaps in content that cause agents to provide wrong answers or fail to help and fix them quickly.

- Optimize knowledge for retrieval. Clean up metadata, improve vector match probabilities, and decide how to chunk knowledge so retrieval is accurate and efficient on latency and cost. Treat the knowledge base as a system the agent reasons over, not a document library.

- Maintain knowledge freshness. Establish review cadences, last-verified dates, and removal protocols. Stale knowledge in an agent KB becomes a confident wrong answer; manage it accordingly.

AI Performance Tuning

- Analyze failed AI conversations to identify knowledge gaps. Read transcripts, listen to calls, and read latency and accuracy logs to see where the agent “got lost” in the knowledge base. Update documentation or metadata to improve future performance and validate the fix worked.

- Optimize retrieval accuracy and response crafting. Use working knowledge of the Sierra tech stack to ensure responses are crafted according to segmentation requirements and decision logic across customer groups and channels.

- Feed back to content owners. Provide feedback to the human-facing KB owners and content standards teams when their standards or content are hindering agent performance, and partner on resolution.

Product Thinking and Experimentation

- Provide feedback to product and engineering. Inform the AI Agent PM and McKesson Technology on prompt improvements and platform enhancements needed for authoring effective agent knowledge. Operate in an agile fashion to adapt to a rapidly changing AI ecosystem.

- Experiment with knowledge approaches. Lead use case evolution by experimenting with options to decide how much deterministic knowledge is necessary versus where to depend on LLM reasoning. The right answer is different for different intents, customer groups, and risk levels.

Minimum Requirement
Degree or equivalent and typically requires 7+ years of relevant experience.

Education
Bachelor's degree

Critical Skills

- 7+ years of experience in Technical Writing, Information Architecture, Conversation Design, Knowledge Management, or Product Operations.

- 1+ year of demonstrated hands-on work with AI knowledge for a deployed conversational or agentic AI system.

- Demonstrated experience authoring structured content for technical or digital systems with the ability to author in a defined brand voice and translate ambiguous human guidance into precise, machine-actionable content.

- Analytical mindset with attention to precision and clarity; able to read transcripts, latency, and accuracy logs to diagnose where the agent failed and why.

- Excellent collaboration skills with both technical (product managers, engineers, data scientists) and non-technical stakeholders (frontline supervisors, SMEs, Legal, brand).

- Experience working in environments with evolving requirements and limited established processes. This role is shaping how the work gets done, not following an established playbook.

Preferred Qualifications

- Experience working with leading LLMs (e.g., Claude, GPT-4, Gemini) and Gen AI concepts including RAG, agentic AI, chain-of-thought prompting, decision flows, and AI reasoning.

- Direct experience with the Sierra platform or a comparable agentic AI platform deployed at enterprise scale.

- Systems thinking: ability to identify downstream implications of knowledge gaps and judgment around edge cases, ambiguity, and exception handling.

- Understanding of semantic precision in the AI context.

- Experience managing knowledge bases or content systems (e.g., KM platforms, CMS tools)

- Contact center, customer service, or BPO domain experience in healthcare, life sciences, or regulated industries.

- Prior experience as a contact center agent, trainer, QA analyst, or knowledge base owner before moving into AI.

- Familiarity with responsible AI principles and risk considerations for regulated customer interactions.

- Familiarity with SQL, Python, or JSON is a plus.

What Success Looks Like in Year One

- Agent accuracy, tone consistency, and hallucination rates meet or exceed McKesson's published targets across go-lives.

- A structured, tagged, and current agent knowledge base is in place, with documented change control and a working synchronization process with the human KB of record.

- A documented tuning backlog is being worked on a predictable cadence, with each change traceable to a transcript, QA finding, or prioritized roadmap item.

- The AI Performance & Quality Analyst reports that observed quality issues are being triaged and resolved through a clear feedback loop.

- The AI Agent PM has a reliable partner for translating roadmap priorities into shipped agent improvements.

- SMEs across NAPS report that the agent reflects their domain accurately and that the process for updating agent knowledge works.

This role is a hybrid position. The selected candidate is expected to work on-site at our Fort Worth office a minimum of two (2) days per week, with the remaining days worked remotely. Specific in-office days may be designated based on team needs and business priorities.

McKesson complies with all applicable U.S. immigration laws and regulations. The Company does not provide employer support or sponsorship for any immigration related employment benefit for this role.
Applicants must be currently authorized to work in the United States on a fulltime basis without the need for employer support or sponsorship now or in the future. This includes having the legal right to work in the United States without the need for McKesson support or sponsorship for any immigration related employment authorization (e.g., H1B, O1, E3, H1B1, TN, F1 OPT, F1 STEM OPT, F1 CPT, etc.) now or in the future.
If you will require McKesson to provide immigration support or sponsorship now or in the future, you should not apply for this position

We are proud to offer a competitive compensation package at McKesson as part of our Total Rewards. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets. The pay range shown below is aligned with McKesson's pay philosophy, and pay will always be compliant with any applicable regulations. In addition to base pay, other compensation, such as an annual bonus or long-term incentive opportunities may be offered. For more information regarding benefits at McKesson, please click here.

Our Base Pay Range for this position

$101,600 - $169,400

McKesson has become aware of online recruiting-related scams in which individuals who are not affiliated with or authorized by McKesson are using McKesson’s (or affiliated entities, like CoverMyMeds or RxCrossroads) name in fraudulent emails, job postings or social media messages. In light of these scams, please bear the following in mind:

McKesson Talent Advisors will never solicit money or credit card information in connection with a McKesson job application.

McKesson Talent Advisors do not communicate with candidates via online chatrooms or using email accounts such as Gmail or Hotmail. Note that McKesson does rely on a virtual assistant (Gia) for certain recruiting-related communications with candidates.

McKesson job postings are posted on our career site: careers.mckesson.com.

McKesson is an Equal Opportunity Employer

McKesson provides equal employment opportunities to applicants and employees, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, age, genetic information, or any other legally protected category. For additional information on McKesson’s full Equal Employment Opportunity policies, visit our Equal Employment Opportunity page.

McKesson is committed to being an Equal Employment Opportunity Employer and offers opportunities to all job seekers including job seekers with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, please contact us by sending an email to (United States) Disability_Accommodation@McKesson.com or (Canada) Accessibility@mckesson.ca. Resumes or CVs submitted to this email box will not be accepted.

Join us at McKesson!

JR0152353