Product Development Pipeline

The objective of any product development process is to create a sustainable and scalable pipeline for delivering innovations, either for net-new products or for creating break-through iterations lifting existing products to the next level.

This pipeline is a generic model that can be customized and tailored to any software development organization. This model is based on a Product Team model and uses OKR’s to track their progress and to align efforts across Product Teams.

1. Enhancements & New Ideas

Objective

While ideas can and should come from anyone, its important to not focus on the ideas but the underlying problems they are describing.

Each product team is responsible for ensuring the growth and long-term viability of their product(s), so it is important for the team to never fall in love with an idea but with the problem. When the team is collecting, organizing and maintaining an active list of ideas to improve their product, it is important to frame them as potential problems the team wishes to address.

In order to find the best problems, the product team needs to gather as many ideas as possible, and from as many sources as possible. Externally this could include market research, customer research, and analyst feedback. Internally this could be from primary R&D, design research, sales, and customer support cases, etc. The goal is to find meaningful problems.

Each Product Team is responsible for weighing and prioritizing which problems they want to address as part of the backlog management. Each idea should be assessed against a common framework such as RICE, KANO, or MoSCoW.

Business Considerations

  • Business objective alignment

  • Leverage tech capabilities

  • ROI projections

Technical Considerations

  • Sustaining engineering

  • Protect the base

  • Impact on tech debt

  • Improve production efficiency

  • Profitably expand program for current populations & clients

  • Profitably adapt program for new conditions/ populations

Activities

  • Collect ideas in a common space that everyone can access

    • Identify gaps, existing customer needs, and market opportunities as starting point for collecting ideas

    • Include any current market and/or competitive research, including emerging trends for both technological and business

    • Include Customer requests

    • internal R&D efforts

  • Run customer and partner co-innovation workshops

  • Maintain competitive assessments (including UX, product, technological)

  • Prioritize ideas

    • Consolidate and de-duplicate ideas

    • Categorized and organize the ideas, (i.e. by size, risk, competitive advantage, revenue, etc.)

    • The team prioritizes the ideas (i.e. simply voting, ranking systems, brainstorming with other product teams, etc.)

    • Move ideas that do not fit criteria to Parking Lot

Outcomes

  • Prioritized list of ideas to move forward with

  • Score and prioritize gaps, customer needs, and market opportunities reflective of the overall company strategy

  • Check against OKRs for potential alignment and connections

  • Identify which items could/should leverage Customer Co-Innovation

  • Move ideas that do not fit criteria to a parking lot

Keep in mind at this point ideas have no inherent value beyond pointing to an underlying problem. During Discovery & Research the team will endeavor to understand if a.) the problem is real, b.) and assuming it is real, how valuable is solving it to customers, and c.) what types of solutions are most likely to be feasible and cost effective to develop.

2. Discovery & Research

Objective

Once the team has identified the problem(s) they want to address, it is time to dive in and get a deep understanding of the problem. The goal is to understand the problem from multiple points of view; there is the user’s POV of course but its also important to to put the problem into context relative to the customer organizations, sales, support, market trends, etc. To do this the team will need to create a research plan. The plan should include things such as:

  • Observational and qualitative interviews with multiple customers, analysts, industry thought leaders, etc.

  • Generative Research for new solutions

  • Adjacent & Analogous product research

  • Benchmarking for existing products

  • Surveys and quantifiable research

  • Evaluative research including competitive benchmarking

  • Explore potential technologies/architectures including deep dives into emerging technologies, new tools, frameworks, etc.

Activities

  • To do this work, the core Product Team will need to establish cross-functional team (i.e., Engineering, QA, Docs, Marketing, etc.)

    • Everyone on the team should participate in the Discovery process.

  • Discovery

    • Recruit participants for observational and qualitative interviews

      • Note this will require people from multiple customers

      • The team should also interview analysts, industry thought leaders, etc.

    • Generative Research

      • Adjacent & Analogous product research

      • Benchmarking for existing products

    • Evaluative Research - benchmarking

      • Competitive Analysis

      • Market assessment

    • Customer co-innovation to define needs and problems

      • Understand their needs, expectations, metrics, and previous solutions, workflows, tools, etc.

      • Explore potential technologies/architectures

      • Identify new workflows, tools, frameworks, etc.

      • Deep dive into emerging technologies (i.e. GenAI) and their potential role in developing a solution

    • Summary of the insights, opportunities, and potential solutions

  • Research

    • Business Considerations

      • Business objective alignment

      • Leverage tech capabilities

      • ROI projections

      • Profitably expand program for current populations & clients

      • Profitably adapt program for new conditions/ populations

    • Technical Considerations

      • Feasibility assessment, architectural impacts, and consideration for tec debt.

      • Technical explorations & experiments

      • Performance and stability risks

      • Impact on production efficiency

      • In-house expertise regarding any emerging technologies or frameworks

  • Note: If during the course of discovery or research there is either a dependency or impact on an existing OKR, that needs to be validated and aligned with that existing OKR.

Outcomes

  • Clear POV on the opportunity to be capture in the 6-Pager (Depending on the scope of the idea a new 6-Pager may not be required in which case the team will need to update their existing 6-Pager.)

    • This should include clear articulation of the business impact(s) and customer value including revenue, market share, customer growth.

    • Additionally any potential implications for the product portfolio and any technical risks/implications, etc.

    • Hypothesis of competitive impact

    • Prioritized set of issues that need to be addressed to deliver a successful solution

    • Placement within the product portfolio, touch points with other products, etc.

  • Initial requirements for the product, user experience and technology including any specific engineering limitations or design principles, including:

    • Initial Use cases

    • Sketches for the architecture, user experience, etc.

    • Idea, concepts, etc.

    • User Task flows

    • Customer Journey Map(s) by role

    • Refined User Task Flows

3. Design & Prototype

Objective

The outcome for this phase is for the team to produce candidate solutions for addressing the problem. To do this, and using the results from the Discovery and Research as guardrails, the team will rapidly iterate between coming up with potential solutions and assessing those solutions. This will help ensure their ideas in fact solve the most important problems, and their solutions have the right balance between innovation and risk before moving on to plan, build and deploy their solution(s).

The creation of the solutions is best achieved by both facilitated in formal brainstorming sessions, and individual ideation time allowing the team diverge and converge their thinking while allowing for inspiration and personal exploration of the problem.

When assessing candidates, the team should focus on how to best de-risk the development by only promoting solutions that address the following:

  • Usability Risk: is the solution is usable, useful, and easy to learn?

  • Feasibility Risk: can it be built in a timely manner? Will it impact tech debt?

  • Viability Risk: will the final solution fulfill its role in the company’s strategy?

  • Value Risk: does the solution provide enough value to make customers spend money for it?

Prototypes can range from simple low-fi, paper prototypes and mock-up, through click-throughs, to working code running canned data. The purpose for prototypes is two-fold: first to help ensure the team’s expectations are aligned for what the solution entails, and second to collect user and stakeholder feedback to refine and improve the solution.

The validation step is completed only when the team is confident that their planned product will create the outcomes that users, customers, and businesses seek.

Activities

  • Ideation

    • Multiple, facilitated creative solutioning sessions (a.k.a., brainstorming)

    • Solo ideation time

    • Multiple customer co-innovation sessions

    • Technical R&D spikes and experiments

  • Prototyping

    • Low-fi paper prototypes → to working code with canned data.

    • Collect user and stakeholder feedback

    • Rapid iterations based on results

  • Validation & Iteration of the prototype(s)

    • Usability impact assessment

      • Review prototypes with users, customers, partners, sales, support, and other stakeholders

      • Run 1:1 usability studies

    • Technical impact assessment

      • Vet prototypes for technical feasibility with the larger engineering organization

    • Refinement of use cases, business case, and technical implications and feasibility based on the various assessments

    • If necessary cycle back to do more discovery & research

  • Leadership team review

Outcomes

  • 6-Pager

    • Market fit assessments

    • Competitive differentiation

    • Define detailed business case, with customer benefits, including clear statement of what the solution will NOT deliver

    • Relevant market history leading to the current situation, resulting the emergence of the problem(s) and opportunity(s)

    • Packaging and Pricing recommendations

    • Long-term strategic implications

  • Clear set of product requirements, initial UX designs, and a implementation plan/architecture (Note: these will be refined to reflect the realities of development.)

  • Draft MVP roadmap, staw-man release plans for the first two quarters

    • Initial set of user stories have been prioritized and have estimated in story points

    • A User Role/Persona have been tied to each story

  • Initial draft OKR’s tied into Company level OKRs, including:

    • Metrics & Performance targets

    • Success criteria are defined

  • Clear Definition of Ready, including:

    • Feature acceptance criteria is defined and documented

    • Initial wireframes completed

    • And epic has been defined

    • Metrics & Performance targets

    • Acceptance criteria including non-functional requirements

    • Detailed product requirements including NFR

  • Approval to move forward with the solution(s) for development

    • This could be determined by the product team for small enhancements or require leadership to move larger initiatives forward

    • For net-new solutions the executive team will review and approve the establishment of any new products on behalf of the business.

4. Plan, Build, & Deploy

Objective

Once a solution has been approved for development the team will need to define their long-term and near term (quarterly) roadmaps to plan their development of the product/service, including critical dependencies, milestones, etc.

Activities

  • Prioritize the product plan including designs, customer feedback, business case, and metrics

  • Syndicate the plan with other teams (i.e. documentation, customer success, customer support, marketing, sales, etc.) to ensure their vision, deliverables and timelines are aligned with other functions and other development efforts.

  • Quarterly planning

    • Product teams will create a theme for their quarter and define a set of OKRs for the quarter (see OKR Process

    • Well defined set of epics and high-level user stories

    • These meetings will focus on the Triad’s Quarterly OKRs and are NOT walk-throughs of the Triad’s epics or high-level user stories.

    • Detailed UX design specifications including wireframes, workflows and design mock-ups

    • Documentation plans for instructional material and in-app help

    • Go-to-Market plans, messaging, sales readiness, etc.

  • Monthly planning

    • Provide leadership updates on OKRs, focusing on their delivery against their Key Results

    • For any issues or blockers, the team should review their mitigations and discuss any implications for their delivery, as well as dependencies from other teams

    • Likewise any updates or adjustments to their key results or other metrics need to be reviewed

  • Sprint Planning

    • Break down epics to stories, including sizing, dependencies, and any required spikes

    • Backlog prioritization, include any required clarification, design,

    • Detailed engineering planning: how the feature/solution will be built, including architectural, data, or infrastructure implications

    • Test plans, automated testing or partial automated testing, and their impact

  • Development

    • Development, test plan creation, code reviews

    • Feature test execution

    • Complete and review test plans

    • Sprint demos

    • Deployment details or dependencies

    • Dev to QA handover readiness

    • QA execute test cases, regression testing, bug closures, etc.

    • Define QA testing targets for:

      • Unit test coverage

      • Automated test coverage

      • Documentation

      • Training

      • Support

Outcomes

  • A clear quarterly plan with OKRs

  • Leadership sign-off go/no go on the plan

  • Any action items for specific development teams to track or report back on.

  • Identify dependencies for other development teams

  • Plans/timelines from Documentation, Training, CSM, Support, etc.

  • High level dependencies list, e.g., epic and feature level

  • Prioritized backlog of stories with sizing to optimize resource

  • Breakout development tickets, with the initial assignments

  • Story level dependency list

  • Alignment across product teams to balance resources, release dates, alignment on external messaging, go-to-market plans, etc.

  • Identify issues for A/B testing of the product

  • Define product instrumentation to track utilization metrics post launch

  • Updated 6-Pager with any changes to the direction, scope, metrics, etc. Additionally capturing any open issues that need to be addressed.

  • Eventually the team will need to check their delivery against their Key Results, if they have delivered their Key Results they have achieved their Objective

    • The team will also need to define their operational objectives and SLA (i.e. five-9’s,

  • Define acceptance criteria including

    • Performance and all conditions

    • Functional completeness

    • User Experience performance, completeness, fit and finish

    • Confirm product meets the business requirements

    • Produced code for presumed functionalities

    • Product/Capability deployed on a test environment identical to customer’s production environment

    • The performance tests passed

    • All bugs fixed

5. Maintain and Improve

Objective

Operate the product, platform and services to meet or exceed the team’s established service level agreement

Activities

  • For Key Results assessing impacts on customer behavior will continue to be tracked and reported on.

    • Again the Objective cannot be consider completed until the required Key Results are delivered.

  • Release notes are written and communicated to the relevant teams

  • Test release candidate builds

  • UAT environment setup, when applicable

  • Security vulnerability scan

  • Leverage instrumentation to understand both utilization, time on task, iterations, etc. for pipeline creation

  • Data Science will capture the intent behind the pipelines to enhance our ML capabilities

  • Data Science will continuously improve our recommendations/ML capabilities

  • Using instrumentation, the team will make determinations for removing features, functionality or services no longer used by customers

  • Looking toward future releases, the team will develop migration plans for moving customers from legacy solutions to current release

Outcomes

  • Regular performance reports with key features, functionality and services broken out by customer, industry, roles, etc.

  • Recommendations to EOL features, functionality, or services

  • Migration plans for future releases

  • Code moved to production

Note

In the spirit that ideas can come from anyone, here are additional sources the product team should consider when collecting ideas…

  • Customer enhancement requests

  • Product monitoring

  • Qualitative feedback

  • Analyst input and feedback

  • Market reports

  • User & design research

  • Customer co-innovation

  • Customer Advisory Panel, Executive Advisors, etc.

  • Corporate Strategy

  • Documentation analytics

  • Customer Support

  • Engineering Ops/QA

  • Technical Debt

  • Grassroots innovations

  • Win/Loss analysis

  • etc. 

Note

Ideas, or rather the problems they represent, should never be immediately added to the product’s roadmap, regardless of where the idea originated.

All ideas should be vetted and run through Discovery & Research, even specific feature requests from customers.

By treating these requests as ideas rather than requirements, a more comprehensive and potentially more valuable solution can be developed that not only addresses the customer’s needs, but also generates greater value for the company

Team

While the Product Team is responsible for the activities during Discovery & Research its strongly suggested that they partner with User Research, and that they open the DIscovery with customers to all the full team from engineering, design, documentation, etc. And that they coordinate with the other Product Teams to ensure they are over taxing customers or partners.

Note

Coming out of Discovery, ideas may be returned to the Parking Lot or disqualified from further development. Disqualified ideas should be documented for future reference.

Team

In addition to the Product Team this step includes the broader team including User Research, Engineering, Documentation, Customer Support, and Customers

Note

This should be an extended process, not a one-off brainstorm.

The goal is to go for quantity over quality, and over time refine and reduce

Note

Based on the Amazon 6-Pager, who’s long format forces the writer to think more deeply about the problem than say a set of bullets in a PowerPoint, the purpose is to capture in one place the intent and scope, and implications for new projects and products. 6-Pagers follow a common outline:

  • Analyst Report from the Future

  • Vision

  • Tenets

  • State of the business

  • Strategy

    • The Problem

    • The Solution

    • Business Expectations

    • Technical Reality

  • Appendix

    • Rude FAQ:

    • References:

    • Glossary