Diff for "LEP/BuildFromBranchIntoPrimary"

Not logged in - Log In / Register

Differences between revisions 7 and 8
Revision 7 as of 2011-01-26 22:20:52
Size: 4810
Editor: mbp
Comment:
Revision 8 as of 2011-01-31 13:35:23
Size: 5445
Editor: jml
Comment:
Deletions are marked like this. Additions are marked like this.
Line 17: Line 17:
''What value does this give our users?'' By allowing Ubuntu developers to build directly from a branch into the primary archive of Ubuntu, we would:
Line 19: Line 19:
 * It removes one unnecessary step.
 * It moves us closer to keeping all code in branches and being able to work with it there, thereby avoiding confusion about whether a branch is in use for a particular package or not.
 * It's hard to use branch-based release management features like merge proposals if people can bypass them by uploading directly.
 * remove one unnecessary step.
 * move closer to keeping all code in branches and being able to work with it there, thereby avoiding confusion about whether a branch is in use for a particular package or not.
 * encourage use of branch-based release management features like merge proposals (currently hard to enforce since people can bypass them by uploading directly)
Line 23: Line 23:
''What costs does this impose on our users?'' === Risks ===
Line 25: Line 25:
* If the server-side building of packages does not work reliably, they will be blocked from uploading. If we retain source package uploads at least as a transitional option there will be an escape from this. If the server-side building of packages does not work reliably, users will be blocked from uploading. We can provide as escape from this by retaining source package uploads at least as a transitional option.
Line 27: Line 27:
 * Errors in packaging may be more difficult to see, understand, or debug if they happen on a server rather than locally. However, developers will still have the option to build the package locally. Errors in packaging may be more difficult to see, understand, or debug if they happen on a server rather than locally. However, developers will still have the option to build the package locally.
Line 29: Line 29:
''Why are we doing this now?'' <<BR>>



''What value does this give our users? Which users?''
Background:
'''Background:'''
Line 53: Line 47:
 * Be as secure as the current dput system. There is great potential for damage here.  * Provide a way to build from current official package branches without uploading a source package and without using manually maintained recipes
Line 55: Line 49:
''What MUST the new behaviour provide?'' Since the aim is to provide a superior alternative to something that already exists within Launchpad, we '''must''' be at least as good as the current system. Specifically:
 * As secure. There is great potential for damage here.
 * As easy to track progress of a build
 * As fast to build, at least
 * As easy to use
Line 59: Line 57:
 * A mechanism for disabling dput uploads, that can be controlled by $WHO
Line 61: Line 61:
''What MUST it not do?''
Line 64: Line 62:

== Subfeatures ==

''Other LaunchpadEnhancementProposal``s that form a part of this one.''
Line 79: Line 73:
 ''How is this workflow discovered? Is this for official package branches only? How does this work for unofficial branches? What are the workflows for failure cases?'' -- jml [[<<Date(2011-01-31T13:35:23Z)>>]]
Line 88: Line 84:
   * ''How are you going to measure this?'' -- jml [[<<Date(2011-01-31T13:35:23Z)>>]]
Line 89: Line 86:
   * ''How are you going to measure this?'' -- jml [[<<Date(2011-01-31T13:35:23Z)>>]]

Build from branch into main

Short description of feature

Contact: MartinPool
LEP: https://dev.launchpad.net/LEP/BuildFromBranchIntoMain
On Launchpad: build-from-branch bugs

As an Ubuntu developer
I want Launchpad to build source and binary packages from branches
so that I don't have to both push the branch and also dput a source package

Rationale

At the moment, after making a change, Ubuntu developers must use bzr-builddeb to build a source package, and then dput to upload it. This is unnecessary work. Some developers only upload and don't push the branch.

By allowing Ubuntu developers to build directly from a branch into the primary archive of Ubuntu, we would:

  • remove one unnecessary step.
  • move closer to keeping all code in branches and being able to work with it there, thereby avoiding confusion about whether a branch is in use for a particular package or not.
  • encourage use of branch-based release management features like merge proposals (currently hard to enforce since people can bypass them by uploading directly)

Risks

If the server-side building of packages does not work reliably, users will be blocked from uploading. We can provide as escape from this by retaining source package uploads at least as a transitional option.

Errors in packaging may be more difficult to see, understand, or debug if they happen on a server rather than locally. However, developers will still have the option to build the package locally.

Background:

Stakeholders

  • Ubuntu developers
  • Linaro developers
  • Ubuntu Technical Board
  • James Westby
  • Kiko Reis
  • Ubuntu technical architect (Allison Randall)
  • Lamont Jones

Constraints and Requirements

Must

  • Provide a way to build from current official package branches without uploading a source package and without using manually maintained recipes

Since the aim is to provide a superior alternative to something that already exists within Launchpad, we must be at least as good as the current system. Specifically:

  • As secure. There is great potential for damage here.
  • As easy to track progress of a build
  • As fast to build, at least
  • As easy to use

Nice to have

  • A mechanism for disabling dput uploads, that can be controlled by $WHO

Must not

Out of scope

Workflows

Publish a change into Ubuntu

  1. User branches from the source package branch.
  2. Make changes
  3. Commit
  4. Push
  5. Request publication

    How is this workflow discovered? Is this for official package branches only? How does this work for unofficial branches? What are the workflows for failure cases? -- jml <<Date(2011-01-31T13:35:23Z)>>

Success

How will we know when we are done?

  • You can build from a branch directly into the main Ubuntu archive

How will we measure how well we have done?

Thoughts?

  • For integration testing, it seems like we need a place where Launchpad developers can publish changes into something that looks a lot like the main Ubuntu archive, without actually being that archive. This could be a separate reserved pocket, or it could be a different Launchpad instance
  • Whereas recipe builds use bzr-builder, this will probably use bzr-builddeb because no recipe is needed
    • We can have bzr-builder degrade to do the same thing as bzr-builddeb.
  • Should packages build and publish on every commit, or should there be a separate request?
  • Eventually it may be useful to have a per-package, per-distrorelease option to turn off source package uploads for areas we have decided branches are the best option. That isn't needed in the first iteration.
  • The things missing from bzr-builder would be:
    • Control over the changelog message used
    • Better control over the resulting version number
    • GPG signatures required for something to end up in Ubuntu (API request isn't GPG signed)
    • Ability to produce non-native tarballs

Changes needed

  • Installer bzr-builder into buildd vms. (May already be done.)
  • If we're not going to build on every commit, then there must be a mechansm to request a build. (Probably a web service api, and a bzr command that calls it.)
  • New type of schedule-able job to request a source package be built from a branch. There is already a db enum for it, but we need to add a new build farm job type.
  • The uploader (or something else?) should sign packages built by the buildds (with which key?). (bug 579870)

  • After that, the binary can be built and published by the existing mechanism, so probably no other changes are needed.
  • As a follow-on, add a mechanism to turn off/refuse dput uploads.

LEP/BuildFromBranchIntoPrimary (last edited 2011-08-16 15:22:51 by jelmer)