Diff for "PolicyAndProcess/QAProcess"

Not logged in - Log In / Register

Differences between revisions 1 and 2
Revision 1 as of 2009-11-27 16:06:56
Size: 1943
Editor: flacoste
Comment:
Revision 2 as of 2009-11-30 03:44:12
Size: 2523
Editor: ursinha
Comment:
Deletions are marked like this. Additions are marked like this.
Line 32: Line 32:
    *     * Leave untested items behind, if not using a bookmarked advanced Launchpad search;
    * Face limitations of Launchpad search that creates barriers instead of removing them;
Line 36: Line 37:
    *     * The intention is to make QA easier by using only Launchpad and removing the need of editing wiki pages, so we'll know we're successful when we have few (or none) items pending to test during the cycle.
Line 40: Line 41:
    *     * Explained in "What we are doing?"
Line 43: Line 44:
        * Launchpad doesn't have in its UI a way to do a full search per team members, as if we're looking in the Wiki page. We only can search items for team or for tag.

  • Name: Pre Release QA Process (Using Launchpad)

  • Owner: Launchpad Team

  • Effective: Under experiment as of 2009-10-01.

  • Experiment: Will replace Pre Release QA Process

  • Review: 2009-12-01

Using Launchpad as main QA tool

Why are we doing this?

  • Improve how we do QA today, by:
    • Being able to search items dynamically using Launchpad search and Launchpad API
    • Not forcing developers to edit the wiki pages to do their QA
  • To reduce/eliminate the number of orphaned commits per cycle.
  • To make easier and more reliable to gather stats of the cycle

What are we doing?

  • Running an automated script that watches the main development branches analysing the commits one by one, as the current test-plan tool does, but instead of adding all items to the wiki test plans, it marks the mentioned bug as Fix Committed in Launchpad, adds a comment to it documenting which commit was responsible for that status change, and adds the qa-needstesting tag. If the commit is an orphaned one, it adds to the team wiki page as a fallback.
  • All the orphaned commits need to be handled by creating one bug for it. The goal is to eliminate orphaned commits per cycle.
  • The search for items to QA to a given person can be done through an advanced bug search in Launchpad:
    • with Fix Committed or Fix Released status
    • with qa-needstesting tag
    • that are assigned to you
    • Don't hide duplicates (some bugs fixed may be dupes of others and not show as pending)

What are the risks?

  • Leave untested items behind, if not using a bookmarked advanced Launchpad search;
  • Face limitations of Launchpad search that creates barriers instead of removing them;

How will we know if we were successful?

  • The intention is to make QA easier by using only Launchpad and removing the need of editing wiki pages, so we'll know we're successful when we have few (or none) items pending to test during the cycle.

Process under experiment

  • Explained in "What we are doing?"

Comments

  • Launchpad doesn't have in its UI a way to do a full search per team members, as if we're looking in the Wiki page. We only can search items for team or for tag.

PolicyAndProcess/QAProcess (last edited 2017-03-30 14:19:02 by cjwatson)