Articles

    Training product managers: build the competency matrix before the academy

    December 7, 2025
    8 min read
    By Alistair Keldovan
    Updated October 12, 2026
    Share this article

    A company that hires twelve PMs a year and lets each one learn the job from whichever manager they land with is running twelve unplanned training experiments. Most produce PMs who are strong where their manager was strong and blind where the manager was blind, and nobody finds out which until a promotion case or a failed launch.

    That is why company PM training now looks more like the way engineers are trained than like a list of courses. Companies have moved past generic onboarding. They now use skill frameworks, internal academies, practice with AI tools and skill matrices tied to promotion. The PM role now covers AI, experiments, data, governance and revenue planning. "Learning on the job" can no longer cover all of that.

    Four shifts made on-the-job learning too slow

    The first shift is AI. It takes away manual work but makes strategy harder. A PM now needs to write good prompts for internal tools. They need to know what models are bad at: they can be slow, expensive or risky. They also need simple ways to tell a good answer from one that only sounds right. Above all, the PM has to judge where AI actually helps the product. That list is much shorter than the list of places where AI could be used.

    The second is the pace of experiments. Teams that run A/B tests every week need PMs who can design a test themselves. That means choosing the metric before the test starts. It means not mistaking random noise for a real result. And it means spotting when two things that move together are sold as cause and effect.

    The third is pricing. More products now sell themselves through the product and charge by usage. So PMs have to work with margins, customer lifetime value (LTV) and unit economics. These used to be finance's job.

    The fourth is scale. Once a company runs many squads, inconsistent PM decisions get expensive. Ten squads making the same prioritization mistake cost ten times as much as one.

    Together, as PM expectations keep widening, these shifts turn each new demand into a training request. Companies have stopped answering them one by one. They now treat PM capability the way they treat sales training: systematic, measurable and repeatable.

    A skills framework needs four domains and one scoring line

    Mid-size and enterprise product organizations increasingly standardize on four domains. The framework is not universal yet, but it is no longer exotic.

    • Strategy: product vision, portfolio strategy, market sizing, AI-opportunity discovery, scenario planning, North Star design, business cases and the unit economics underneath them.
    • Execution and craft: discovery, research synthesis, prioritization (RICE, MoSCoW, weighted models), story mapping, technical literacy around APIs, models and data, experiment design, launch readiness and stakeholder communication.
    • Data and experimentation: funnel analytics, event instrumentation, cohort analysis, segmentation, significance and power, A/B interpretation and growth-loop design.
    • Leadership and collaboration: cross-functional orchestration, influence without authority, OKR design, conflict resolution and PM-to-PM protocols.

    Companies push data and experimentation hardest. Every PM who can read a cohort chart on their own sends fewer requests to the analysts.

    Competency matrices then define what "good" looks like at each level. An Associate PM handles basic analytics and scoped execution. A mid-level PM owns a problem space and runs experiments. A Senior PM leads strategy and builds growth systems. A Principal PM works across products. A Group PM builds capability through hiring and mentorship.

    The scored dimensions stay the same at every level: strategic thinking, customer insight, experimentation quality, execution reliability, technical fluency, communication and monetization knowledge. That consistency lets skill-assessment tools produce objective evaluations that survive a change of manager.

    A simple scoring line keeps the matrix honest:

    Level readiness = average of the 7 dimensions, each scored 1 to 4, with no dimension below the level's floor

    Take a mid-level PM who scores 3, 3, 2, 4, 3, 3, 2. The average is 20 / 7 ≈ 2.9, close to a Senior bar of 3.0. But experimentation quality sits at 2, below a Senior floor of 3. The promotion case waits, and the gap becomes the PM's next training module.

    Academies earn their cost in simulation hours

    The companies furthest along run internal PM academies: always-on programs modeled on engineering bootcamps. They run in sequence from curriculum to applied practice to a capstone assessed by senior leaders.

    The foundations layer covers fundamentals, user research, discovery, problem framing and prioritization. Teresa Torres's "Continuous Discovery Habits" (2021) is a common spine here, because it turns discovery into a weekly routine with no start or end date. Advanced tracks then specialize: AI features and model evaluation, growth and experimentation, data literacy, monetization, product-analytics pipelines.

    The highest-value layer is live simulation, because judgment forms in situations rather than lectures. PMs plan an MVP under constraint, redesign an onboarding flow, prioritize an experiment backlog, negotiate scope against engineering limits and defend a monetization approach across several scenarios.

    Around that sit guilds for AI, growth, research, B2B and mobile, where patterns and mistakes travel across teams. The capstone asks each PM to defend a strategy, an experiment plan or a monetization model in front of senior leaders.

    The payoff is consistency. Skill development stops depending on which manager a PM reports to. Onboarding shortens because the first weeks are structured. Capability gaps become visible before a role opens.

    None of this is new. Marty Cagan argued in "Empowered" (SVPG, 2020) that coaching the people on the team is a product leader's most important responsibility. An academy puts that argument into practice: the company stops leaving coaching to whichever manager happens to be good at it.

    What does an AI tutor do better than a two-day workshop?

    It finds the specific gap. An AI tutor can locate weak spots in experimentation, data reasoning, technical knowledge or strategy articulation and recommend targeted modules. A senior PM stops sitting through fundamentals used daily.

    It can also generate scenarios (a market shift, a behavior change, a feature failure) and review PRDs, OKRs, roadmaps and hypotheses with structured feedback.

    Use it as an experimentation coach at the moment of decision. Before launch it should make the PM:

    1. write a hypothesis a result could falsify;
    2. pick the primary metric before seeing data;
    3. fix a stopping rule in advance;
    4. judge the result against the original question;
    5. separate effect from noise with a preset threshold.

    Step three matters more than it looks. A PM who checks the dashboard daily and stops at the first significant reading gives noise a fresh chance to cross the threshold every morning, and the coach is cheap insurance against that habit. A retrospective three months later finds the same mistakes after they ship.

    The tool alone does not train anyone, though. In January 2026 Ilia Martyn published a Habr analysis of 122,346 anonymized requests to a shared AI tool at an education company with about 500 staff. Most people, 416 of 527, used it at least once. But 58% of users had received no training at all. A fifth of the users produced almost 80% of the spend. The author himself warns that the savings estimates are probably inflated. The usage pattern still says something useful: access without coaching leaves most of a tool's value with a fifth of its users.

    PMs are not waiting for permission either. A Le Ticket survey of more than 1,000 product professionals in France, published in September 2025, found 38% paying for an AI tool out of their own pocket, mostly under 30 euros a month. If the company does not set the standard, each PM sets a private one.

    Simulated negotiations with engineering, design or executives add reps for influence. None of this replaces human coaching. It adds personalization, repetition and speed where they matter most.

    Partner functions need the same vocabulary

    In 2026 PM training also reaches engineering, design, research, data, sales and marketing. The same words mean different things to different teams. Decisions stall while teams find out they agreed to different things. Shared training gives everyone the same words, so fewer decisions have to be argued again.

    Each partner function takes the slice it shares with product:

    • engineers learn PM decision frameworks, hypothesis-first planning and how to raise AI-feasibility limits early;
    • designers learn experimentation guardrails and analytics-informed UX changes;
    • data teams learn to state insight in product language and apply experiment governance;
    • go-to-market teams learn monetization logic, segmentation and lifecycle design.

    Suppose a cross-team misunderstanding costs one re-planning meeting of six people for an hour each week. Over about 50 working weeks that is 300 person-hours a year per squad. Across ten squads it reaches 3,000 hours, roughly a year and a half of one person's full-time work.

    Measure the academy against escalations and rework

    An academy is an investment, so companies measure it. Skill assessments give scores. Product signals include how many experiments ship, gains in activation and retention, how fast work moves, how often the roadmap holds and how much work gets redone. Team signals are softer but easy to see: less back-and-forth and fewer times a manager has to step in. A steady drop in escalations is usually the earliest sign that training landed.

    The economic case fits in one line:

    Academy payback = (PMs onboarded per year × weeks of ramp saved × weekly loaded cost) / annual academy cost

    With illustrative inputs: 12 new PMs a year, 4 weeks of ramp saved each, $3,500 of loaded cost per week. That is 12 × 4 × $3,500 = $168,000 a year. Against an academy costing $120,000 a year, the payback ratio is 1.4, before counting rework avoided.

    Faster ramp is easy to over-credit, since a cohort hired into a calmer quarter ramps faster anyway. Compare cohorts hired in similar conditions before crediting the academy.

    The reason to fund it has little to do with a learning culture. Tough markets punish sloppy work. Generative AI keeps opening new kinds of products that need experienced people. And growth teams cannot work with partners who do not understand experiments. Weak PM capability shows up as product debt and wasted engineering time long before it shows up in an engagement survey. Academies also relieve hiring pressure by producing senior PMs instead of competing for them.

    Build the competency matrix before the curriculum

    The sequence that works is less glamorous than an academy launch. Write the competency matrix first, with the four domains and the level expectations above, and score current PMs against it honestly. The gaps it exposes are the curriculum.

    Pick the one or two domains where weak capability costs the most, usually data and experimentation. Build foundations and a live simulation for those first. Decide up front which signals you will watch (escalations, rework, experiment quality) so the program can be judged after two or three cohorts.

    Add AI coaching and cross-functional tracks once the core standard is stable. Personalization only helps when there is a clear standard to personalize against.

    A course catalog nobody can tie to a promotion decision is a cost; a matrix with a curriculum behind it is a system.

    Related Articles