#format IRC
<matsubara> #startmeeting
<MootBot> Meeting started at 10:00. The chair is matsubara.
<MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
<matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
<matsubara> [TOPIC] Roll Call 
<MootBot> New Topic:  Roll Call
<matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
<Chex> here
<gary_poster> me
<abentley> matsubara, hello, my name is rockstar
<gary_poster> heh
<matsubara> hi abentley, welcome :-)
<abentley> (rockstar is not well)
<flacoste> me
<matsubara> just saw his email, thanks for standing in
<matsubara> bigjools, danilos, Ursinha, sinzui, allenap: hi
<bigjools> o/
<allenap> me
<matsubara> ok, let's move on while others can join in later
<matsubara> [TOPIC] Agenda 
<MootBot> New Topic:  Agenda
<matsubara>  * Actions from last meeting
<matsubara>  * Oops report & Critical Bugs & Broken scripts
<matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
<matsubara>  * DBA report (stub)
<matsubara>  * Proposed items
<matsubara> [TOPIC] * Actions from last meeting
<MootBot> New Topic:  * Actions from last meeting
<matsubara>  * matsubara to email Tim about https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1488EA174 and 
<matsubara>     * Filed bug 520446 and emailed Tim about it.
<matsubara>  * matsubara to talk to leonard about https://lp-oops.canonical.com/oops.py/?oopsid=OOPS-1488EA884
<matsubara>     * Talked to leonard about this one, details added to bug https://bugs.edge.launchpad.net/launchpad-foundations/+bug/271029
<matsubara>  * rockstar to investigate OOPS-1480CMP1 and fill in details on bug 517126
<matsubara>  * matsubara to ask stub to send the dba report to the list
<matsubara>     * emailed stub about this week and last week report (2010-02-11)
<matsubara>  * rockstar to raise the importance of ensuring sufficient monitoring of this part (i.e. branch updates emails failing to be delivered) of code-hosting by thumper
<matsubara>  * Gary talk about "too many different kinds of moving parts" in our architecture. If we have fewer moving parts then we can institute more uniform nagios-like-checks.
<matsubara>  * Ursinha to talk to rockstar about bug 514461
<matsubara>    * rockstar said: "yes, I have been trying to get it landed for a week.  If it got into production-stable, then I'm going to have it CP'd today (02/04)."
<matsubara>  * Ursinha to talk to mwhudson about bug 513412
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1488EA174
<ubottu> Launchpad bug 520446 in launchpad-code "OOPS creating duplicate merge proposal using API" [Undecided,New] https://launchpad.net/bugs/520446
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1488EA884
<ubottu> Launchpad bug 517126 in launchpad-code "BzrCheckError raised creating a merge proposal" [Undecided,New] https://launchpad.net/bugs/517126
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1480CMP1
<ubottu> Ubuntu bug 271029 in launchpad-foundations "ForbiddenAttribute exception raised changing property of object" [Medium,Triaged]
<ubottu> Launchpad bug 514461 in launchpad-code "scan_branches.py screams and no one is listening" [Critical,Fix released] https://launchpad.net/bugs/514461
<ubottu> Bug 513412 on http://launchpad.net/bugs/513412 is private
<matsubara> gary_poster, did you talk about your meeting action during the TLs meeting?
* mrjazzcat (~mrjazzcat@c-24-9-91-150.hsd1.co.comcast.net) has joined #launchpad-meeting
<gary_poster> matsubara: yes I did.  It is now in BjornT's hands to decide what, if anything, we do about it, I think
* danilos has quit (Ping timeout: 265 seconds)
<Ursinha> matsubara: I talked to rockstar but not with mwhudson, sorry
<matsubara> gary_poster, ok, thanks for bringing that up
<matsubara> [action] * Ursinha to talk to mwhudson about bug 513412
<ubottu> Bug 513412 on http://launchpad.net/bugs/513412 is private
<MootBot> ACTION received:  * Ursinha to talk to mwhudson about bug 513412
<ubottu> Bug 513412 on http://launchpad.net/bugs/513412 is private
<matsubara> [action] * rockstar to investigate OOPS-1480CMP1 and fill in details on bug 517126
<MootBot> ACTION received:  * rockstar to investigate OOPS-1480CMP1 and fill in details on bug 517126
<ubottu> Launchpad bug 517126 in launchpad-code "BzrCheckError raised creating a merge proposal" [Undecided,New] https://launchpad.net/bugs/517126
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1480CMP1
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1480CMP1
<abentley> matsubara, it appears this was not completed.
<matsubara> it wasn't. I'm re-adding it to the meeting action items so I can bring it up again next week
<matsubara> I think that's it for actions from the last meeting
<matsubara> let's move on
<matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
<MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
<matsubara> abentley, I filed bug https://bugs.edge.launchpad.net/launchpad-code/+bug/520482
<ubottu> Ubuntu bug 520482 in launchpad-code "ValueError oops raised creating merge proposal with different values for review_types and reviewers" [Undecided,New]
<abentley> matsubara, rockstar did raise the oops issue with us.
<matsubara> ubuntu bug?
* salgado-lunch is now known as salgado
<abentley> matsubara, okay, is there something you want me to do about that bug?
<matsubara> abentley, could you please fill in the details in the bug report?
<matsubara> abentley, fill in the details about the oops rockstar discussed in the code team
<matsubara> about bug 520482, could you triage and get that one assigned?
<ubottu> Launchpad bug 520482 in launchpad-code "ValueError oops raised creating merge proposal with different values for review_types and reviewers" [Undecided,New] https://launchpad.net/bugs/520482
<matsubara> there's another one related to that bug 520446, which I emailed tim about today
<abentley> matsubara, sorry, I meant that rockstar raised the issue of monitoring emails.
<ubottu> Launchpad bug 520446 in launchpad-code "OOPS creating duplicate merge proposal using API" [Undecided,New] https://launchpad.net/bugs/520446
<matsubara> abentley, cool.
<abentley> matsubara, sure I can set the status high, but why do you believe it should be assigned immediately?
<matsubara> abentley, setting it to high and nobody taking ownership means it'll stay there forever
<matsubara> abentley, otoh, maybe it's not a big deal
<matsubara> although it's the second top oops on yesterday's lpnet report
<abentley> matsubara, no, it doesn't.  I have been working on high bugs this week and last.
<abentley> matsubara, and there are oops bugs that I think should be fixed before this one.
<matsubara> abentley, that's cool. setting it to triaged and some status according to your teams priority is already good enough for me, as long as those oopses don't fall through the cracks
<matsubara> gary_poster, any news about bug 450593?
<ubottu> Launchpad bug 450593 in launchpad-foundations "Still seeing non-informational DisconnectionErrors on login servers" [High,Triaged] https://launchpad.net/bugs/450593
<matsubara> still seeing some DE errors on lpnet summaries
<gary_poster> matsubara: I don't think that's the most up-to-date bug on this, but could be wrong.  I'll investigate for next mtg
<matsubara> gary_poster, and bug https://bugs.edge.launchpad.net/launchpad-foundations/+bug/403618 ? it's the top one on edge summaries. can we get someone assigned to fix that one?
<ubottu> Ubuntu bug 403618 in launchpad-foundations "Launchpad should return a 404 instead of ForbiddenAttribute OOPS" [High,Triaged]
<gary_poster> matsubara: ack
<gary_poster> will do
* danilos (~danilo@canonical/launchpad/danilos) has joined #launchpad-meeting
<matsubara> [action] gary_poster to check status on work for DisconnectionErrors (bug 450593) and assign bug 403618 to someone in foundations
<ubottu> Launchpad bug 450593 in launchpad-foundations "Still seeing non-informational DisconnectionErrors on login servers" [High,Triaged] https://launchpad.net/bugs/450593
<MootBot> ACTION received:  gary_poster to check status on work for DisconnectionErrors (bug 450593) and assign bug 403618 to someone in foundations
<ubottu> Launchpad bug 403618 in launchpad-foundations "Launchpad should return a 404 instead of ForbiddenAttribute OOPS" [High,Triaged] https://launchpad.net/bugs/403618
<matsubara> ok, that's all for oops
<matsubara> let's see the scripts and critical bugs
<matsubara> karma-updater failing again, which sinzui already replied to
* jtv (~jtv@jtv.xs4all.nl) has joined #launchpad-meeting
<matsubara> checkwatches hung and killed by spm
<matsubara> allenap, is someone chekcing that checkwatches issues? can you reply to the email spm sent to the list?
* DavidLevin has quit (Quit: Leaving)
<allenap> matsubara: I haven't seen that message, unless it was some time ago?
<matsubara> allenap, my email client says spm sent his email 11 hours ago
<matsubara> allenap, subject Re: Scripts failed to run: loganberry:karma-update, loganberry:allocate-revision-karma, loganberry:launchpad-stats, loganberry:expire-questions, loganberry:checkwatches, loganberry:productreleasefinder, loganberry:update-cache, loganberry:launchpad-targetnamecacheupdater
<allenap> matsubara: Cool, found it. I'll reply.
<matsubara> thanks allenap 
<matsubara> we have 5 critical bugs
<matsubara> 3 fix committed and 2 triaged
<matsubara> https://bugs.edge.launchpad.net/launchpad-foundations/+bug/511567
<ubottu> Ubuntu bug 511567 in launchpad-foundations "Can't remove authorised oauth tokens" [Critical,Triaged]
<matsubara> https://bugs.edge.launchpad.net/launchpad-foundations/+bug/514267
<ubottu> Ubuntu bug 514267 in launchpad-foundations "InternalError on clusters under busy load" [Critical,Triaged]
<matsubara> the latter one seems to be in progress
<matsubara> gary_poster, and the former one doesn't seem critical. is it really?
<gary_poster> matsubara: no.
<matsubara> ok. set to high then. IIRC, Curtis had a branch to fix that one
<matsubara> I'll assign to him
<gary_poster> ah ok, thanks
<matsubara> ok, thanks everyone. let's move on
<matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
<MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
<Chex> hello everyone
<Ursinha> wq
<Ursinha> oops, sorry :/
<Chex> - New branch-scanner setup again with 8944 CP; seems to be working well now.
<Chex> - DB Relication Lag/Slave-master issue: We are still running on the fake lag script pointing all traffic at the main
<Chex>         production db.  It appears as though we are blocked on Stuart's return before any progress is likely to be made
<Chex>         on this.
<Chex> - LP incidents of note:
<Chex>         ; LP Cherry-picks: 8944 to Codehost; loganberry bzrsyncd on 08-Feb,
<Chex>             CP 8945; rolled out to: germanium/ppa respectively on 10-Feb
<Chex> anyone have questions/comments on this?
* DavidLevin (~dslevin@67-210-33-186.ul.warwick.net) has joined #launchpad-meeting
<matsubara> thanks Chex 
<matsubara> [TOPIC] * DBA report (stub)
<MootBot> New Topic:  * DBA report (stub)
<matsubara> I emailed stub to sent the DBA report to the list
<matsubara> [TOPIC] * Proposed items
<MootBot> New Topic:  * Proposed items
<matsubara> no new proposed items
<matsubara> anything else before I close?
<sinzui> yes
<matsubara> go ahead sinzui 
<sinzui> http://people.canonical.com/~lpqateam/test-plan-report-10.02.html
<sinzui> ^ Is every team looking at this every day?
<MootBot> LINK received:  http://people.canonical.com/~lpqateam/test-plan-report-10.02.html
<abentley> sinzui, no idea.
<jtv> sinzui: cool, I wasn't aware of that one... will there be a single link for the current milestone?
<sinzui> matsubara: I moved some contributor landings from other testplans listed on to the wiki to my teams wiki page because I was tracking the bug on my teams milestone...there is a disconnect between where the wiki entry is and the qa-needtesting bug tag
<sinzui> jtv: I added the link to milestones I watch so that I am reminded of this: https://edge.launchpad.net/launchpad-registry/+milestone/10.02
<matsubara> sinzui, what do you mean by disconnect between the wiki entry and the qa-needstesting tag?
<jtv> sinzui: I hope this will become fully LP-native at some point, it's very cool!
<matsubara> sinzui, AFAICT, only translations is using the qa-needstesting tag
<Ursinha> sinzui: that happens because the scripts track the committers and not the teams
<sinzui> matsubara: jpds's bugs are on ^ my milestone page, but his entries are added to a different wiki page tan my entires, so I must hunt for them
<matsubara> sinzui, you mean LaunchpadTestPlan wiki page?
<bigjools> that will get even more disconnected as we do more feature-based teams
<sinzui> We agreed we would all use them starting in 10.02
<Ursinha> sinzui: so if henninge commits a fix for a bug in registry, it will show up in translations test plan
<matsubara> that's because external contributors don't have a team
<matsubara> they work on whatever they want
<sinzui> matsubara: correct
<abentley> jml is showing up under code team, but he isn't part of that team anymore.
<sinzui> Ursinha: Correct
<matsubara> so, that's why they end up in the LP test plan wiki page
<Ursinha> matsubara: correct :)
<matsubara> do I get a A+ for all the above correct answers?
<Ursinha> sinzui: this can be changed if needed, it's just a matter of thinking about how
<Ursinha> matsubara: :)
<sinzui> I would prefer to never visit the wiki. I need to visit the wiki to prove QA is being done
<jml> please give me my own page! :)
<Ursinha> sinzui: I'm working on it
<bigjools> jml: would it have anything on it?  /me hides
<Ursinha> sinzui: and I thought that the migration would be done after all possible problems pointed in the experiment being fixed
<sinzui> actually, jml and mrevell do need a page
<sinzui> or something that makes it easy to see that they have verified their work this cycle
<sinzui> I do not think mrevell knows he has lots of entries hidden on a page from last release
<matsubara> [action] Ursinha to set up StrategyTeamTestPlan wiki for jml,mrevell
<MootBot> ACTION received:  Ursinha to set up StrategyTeamTestPlan wiki for jml,mrevell
<mrevell> sinzui, Hidden entries?
<matsubara> sinzui, I usually remind him
<Ursinha> sinzui: if you're talking about the Launchpad testplan, we usually poke him for that
<matsubara> but it's better if the strategy team has their own TP
<matsubara> hi mrevell  :-)
<Ursinha> matsubara: sinzui, that would be easy to do
<Ursinha> but the idea is to get rid of wikis, right?
<mrevell> hey matsubara, I'll talk to you outside the meeting
<sinzui> mrevell: https://dev.launchpad.net/LaunchpadTestPlan/10.01
<Ursinha> I thought there was an agreement on it! Or maybe I got it wrong
<Ursinha> I'll set up the page for them to use while we don't migrate
<abentley> kanban is also supposed to be tracking QA.  Do we have a plan to keep everything in sync?
<matsubara> Ursinha, we will get rid of the wiki once the work on bug tagging is done. if that's not ready yet, my suggestion is to create the wiki page for jml and mrevell so they will be able to track the QA needed for their work
<matsubara> kanban too?
<matsubara> that's new to me
<Ursinha> so to me
<sinzui> abentley: BjornT will be working on syncing via API
<Ursinha> ah
<Ursinha> ok
<sinzui> abentley: BjornT wants every change in LP sent to the kanban boards
<matsubara> oh
<matsubara> Ursinha, I guess you'll need to talk to BjornT then
<matsubara> before working on the qa tagging thing
<mrjazzcat> matsubara: or me :-)
<Ursinha> matsubara: actually no
<Ursinha> matsubara: well, he's going to perform a search on bugs with tags and yada
<Ursinha> matsubara: I'll talk to him to confirm that :)
<matsubara> my point exactly :-)
<matsubara> anyway, sinzui, do you have anything else?
<sinzui> matsubara: no
<matsubara> thanks. as a general reminder, please try to keep an eye on the test plan report page for the current cycle, and spread the word to your teammates: http://people.canonical.com/~lpqateam/test-plan-report-10.02.html
<matsubara> I think that brings the meeting to an end
<matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs. 
<matsubara> #endmeeting