#format IRC
<Ursinha> #startmeeting
<Ursinha> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
<MootBot> Meeting started at 11:01. The chair is Ursinha.
<MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
<Ursinha> [TOPIC] Roll Call
<Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
<Ursinha> me
<MootBot> New Topic:  Roll Call
<gary_poster> me
<sinzui> me
<allenap> me
<rockstar> me
<chex> me
<Ursinha> awesome
* salgado has quit (Quit: rebooting, brb)
<Ursinha> bigjools is missing
* matsubara (~matsubara@canonical/launchpad/matsubara) has joined #launchpad-meeting
<Ursinha> matsubara, hello buddy
<Ursinha> I asked al-maisan if he can join us in behalf of soyuz
<Ursinha> moving on
<Ursinha> [TOPIC] Agenda
<Ursinha>  * Actions from last meeting
<Ursinha>  * Oops report & Critical Bugs & Broken scripts
<Ursinha>  * Operations report (mthaddon/Chex/spm/mbarnett)
<Ursinha>  * DBA report (stub)
<Ursinha>  * QA stats of the week
<Ursinha>  * Proposed items
<MootBot> New Topic:  Agenda
<Ursinha> [TOPIC] * Actions from last meeting
<Ursinha>  * Ursinha to send email to TLs about QA summaries
<Ursinha>    * I haven't, I suck. Will do that before my EOD
<Ursinha>  * matsubara to triage open oops-tools bugs
<Ursinha>  * sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script
<Ursinha>  * allenap to discuss with deryck about OOPS-1544A949 and file a bug for OOPS-1545E465.
<Ursinha>    * OOPS-1544A949 is really bug 433995 <https://launchpad.net/bugs/433995>.
<Ursinha>    * Bug 547063 <https://launchpad.net/bugs/547063> has been filed for OOPS-1545E465.
<Ursinha>  * matsubara to fix linked bug for OOPS-1545E465
<Ursinha>     * done.
<Ursinha>  * gary_poster to discuss OOPS-1541O1653 with salgado and file a bug for it.
<Ursinha>     * https://bugs.edge.launchpad.net/launchpad-foundations/+bug/547054
<Ursinha>  * matsubara to email stub asking the dba report
<Ursinha>     * done.
<MootBot> New Topic:  * Actions from last meeting
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1544A949
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1545E465
<ubottu> Ubuntu bug 433995 in malone "Cannot edit importance, status or assignee after changing project inline" [High,Triaged]
<ubottu> Launchpad bug 433995 in malone "Cannot edit importance, status or assignee after changing project inline" [High,Triaged] https://launchpad.net/bugs/433995
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1544A949
<ubottu> Ubuntu bug 547063 in malone "None isn't acceptable as a value for BugActivity.person" [High,In progress]
<ubottu> Launchpad bug 547063 in malone "None isn't acceptable as a value for BugActivity.person" [High,In progress] https://launchpad.net/bugs/547063
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1545E465
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1545E465
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1541O1653
<ubottu> Ubuntu bug 547054 in launchpad-foundations "AssertionError: Don't try to render this page when the user is logged in." [High,Fix committed]
* salgado (~salgado@canonical/launchpad/salgado) has joined #launchpad-meeting
<Ursinha> matsubara, what about yours?
<matsubara> not done the triage, please re-add
<Ursinha> yes sir
<matsubara> I think I fixed the linke bug for that oops
* salgado is now known as salgado-lunch
<Ursinha> [action]  matsubara to triage open oops-tools bugs
<MootBot> ACTION received:   matsubara to triage open oops-tools bugs
<Ursinha> matsubara, it's marked "done", so I guess you did
<danilos> me
<danilos> :)
<Ursinha> sinzui, what about yours?
<Ursinha> danilos, you're late boss
<Ursinha> :P
* danilos is sorry, lucid is all over him now
<Ursinha> excuses, excuses... 
<sinzui> Ursinha, I have not done that
<Ursinha> sinzui, do you intend to?
* DavidLevin has quit (Ping timeout: 264 seconds)
<sinzui> yes. I think it is not as important as the real oopses and blockages that my team have
<Ursinha> [action] sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script 
<MootBot> ACTION received:  sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script
<sinzui> wrong action
<sinzui> Ursinha, the losas will not make changes to the scripts. they invited me to submit a patch
<Ursinha> sinzui, ah, ok
<Ursinha> sinzui, so it's up to you to send a patch and fix that
<Ursinha> ?
<sinzui> correct
<Ursinha> [action] cancel last item
<MootBot> ACTION received:  cancel last item
<Ursinha> sinzui, is there a bug for that?
<Ursinha> I can file one and then remove the action item
<Ursinha> we can follow up in the bug then
<sinzui> not that I am aware of. I do not even know which project minds that code
<Ursinha> sinzui, I'll go figure that out
* sinzui has a team and QA crisis last week and this week
<Ursinha> [action] Ursinha to file a bug about setting the increase threshold for the product release finder monitoring script
<MootBot> ACTION received:  Ursinha to file a bug about setting the increase threshold for the product release finder monitoring script
<Ursinha> sinzui, QA crisis?
<Ursinha> we can discuss that during the qa stats section...
<Ursinha> [TOPIC] * Oops report & Critical Bugs & Broken scripts
<Ursinha> oops section is all foundations today: four bugs
<MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
<sinzui> the suggest packages feature on the product page was bad. I did not want users to see an incomplete feature
<sinzui> We could not fix the feature because we were blocked on another feature.
<Ursinha> sinzui, ah, I recall the discussion
<Ursinha> gary_poster: I filed bug 553361 re. the referrer oops. is it hard to fix?
<Ursinha> gary_poster: also filed bug 553368 re. the DiscoveryFailures
<Ursinha> gary_poster: and bug 474774 is responsible for about 30 oopses a day, any chances of being fixed soon? :)
<Ursinha> gary_poster: is bug 547054 really fixed? I still see a few oopses in lpnet
<ubottu> Launchpad bug 553361 in launchpad-foundations "OOPS when accessing launchpad with no referrer, eg. via wget" [High,Triaged] https://launchpad.net/bugs/553361
<ubottu> Launchpad bug 553368 in launchpad-foundations "Better handling of errors when trying to login when the op is down" [Undecided,New] https://launchpad.net/bugs/553368
<ubottu> Launchpad bug 474774 in launchpad-foundations "Non-ascii in the URL causes an OOPS" [High,Triaged] https://launchpad.net/bugs/474774
<ubottu> Launchpad bug 547054 in launchpad-foundations "AssertionError: Don't try to render this page when the user is logged in." [High,Fix committed] https://launchpad.net/bugs/547054
<gary_poster> 553361: we'll get that this cycle.  I'm not sure what the right solution is, but whatever it is, it shud be easy.
<gary_poster> it is scheduled for this cycle
<Ursinha> gary_poster, great
<gary_poster> 553368: will probably triage low
<Ursinha> 553361 has about 1k oopses in lpnet partial summaries :/
<gary_poster> 474774: noure we'll have time this cycle, but maybe.
<gary_poster> not sure
<gary_poster> 547054: if we are still getting OOPSes, then I suppose it is not fixed.  The remaining situations should be fairly low priority, but I'll ask salgado about them.
<Ursinha> thanks gary_poster 
<gary_poster> thank you
<Ursinha> we have one bugs' oops, that allenap already found the bug and triaged as high: bug 365092
<ubottu> Launchpad bug 365092 in malone "Some bugs have BugMessage records with no corresponding MessageChunk records" [High,Triaged] https://launchpad.net/bugs/365092
<Ursinha> oops-prune, expire-ppa-files and calculate-bug-heat have been failing
<Ursinha> the last one, according to spm, was running while the check ran, should we change something to fix that?
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
<Ursinha> the failing scripts, that is
<allenap> Ursinha: It's named calculate_bug_heat (note the underscores) in the script. Could that cause this?
<allenap> chex: ^
<Ursinha> allenap, that's just my typo, sorry
<chex> allenap: ok, looking at it
<allenap> As in, does this check refer to ScriptActivity, or is it an OS thing.
<Ursinha> who should take care of the running scripts, losas or foundations?
<allenap> Ursinha: I can talk to chex about this outside of the meeting.
<Ursinha> thanks allenap :)
<chex> allenap: sorry, I need more context here, not quite following, my apologies
<Ursinha> [action] allenap to talk to chex after the meeting about the calculate_bug_heat failing script
<MootBot> ACTION received:  allenap to talk to chex after the meeting about the calculate_bug_heat failing script
<Ursinha> about the other two
<Ursinha> [action] Ursinha to investigate about oops-prune and expire-ppa-files failing scripts
<MootBot> ACTION received:  Ursinha to investigate about oops-prune and expire-ppa-files failing scripts
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
<Ursinha> moving on
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
<Ursinha> we have three critical bugs, all fix committed
<Ursinha> I suppose they were rolled out yesterday
<Ursinha> moving on
<Ursinha> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
<MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
<Ursinha> or chex :P
* Ursinha pokes ChanServ 
<Ursinha> errr
* Ursinha pokes chex 
<chex> wow
<chex> sorry folks.. here is the LOSA report for this week
<chex> - Launchpad Full Production V10.03 was rolled-out on Wednesday morning, some replication issues
<chex>         caused the roll-out to take a hour longer than expected.
<chex>      Some notes:
<chex>         : The SSO DB Migration project is now complete, SSO is now using its own master DB.
<chex>         : A Handful of scripts needed to be modified to work after the rollout,
<chex>         mostly due to master/slave Postgres access changes, and have been fixed.
<chex>         : There will be readonly downtime tomorrow at 09:00 UTC while we switch the authDB master
<chex>         for LP which will complete the "SplitIt" project.
<matsubara> Ursinha, keep poking ChanServ and it'll kick ban you hehe
<chex> - ImportD large imports still causing problems:
<chex>         : Pear had to be restarted last Thur 25-Apr after a large git import,
<chex>         Bug# 536486 is still relevant.
<chex> and thats all for this week, any comments/questions?
<Ursinha> bug 536486
<ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
<gary_poster> (yay about SplitIt!)
<Ursinha> chex, mwhudson was working on bug 536486, it seems, but has no assignee now
<ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
<Ursinha> rockstar, do you know something about that?
<rockstar> Ursinha, well, it's a bug in bzr-git and jelmer is investigating it.
<rockstar> The Kernel import has the same issue.
<Ursinha> rockstar, bzr-git? so not launchpad actually?
<rockstar> Ursinha, yes, at least that's what we believe.
<rockstar> But what "launchpad" means is a bit fuzzy.  It's the import worker that has the issue.
<Ursinha> rockstar, right.. can you explain that in the bug, please?
<Ursinha> maybe add another bugtask to bzr-git
<rockstar> Ursinha, I'm sure I can have someone else do it.
<Ursinha> rockstar, thank you very much
<chex> Ursinha: thank you guys, this is a serious problem we need to address somehow..
<Ursinha> [action] rockstar to find someone to look at bug 536486 and update it
<MootBot> ACTION received:  rockstar to find someone to look at bug 536486 and update it
<ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
<chex> rockstar: you as well, sorry. :)
<Ursinha> anyone else?
<Ursinha> [TOPIC] * DBA report (stub)
<Ursinha> stub is excused due to our "late" meeting, he already sent the report to the list
<MootBot> New Topic:  * DBA report (stub)
<Ursinha> [TOPIC] * QA stats of the week
<MootBot> New Topic:  * QA stats of the week
<Ursinha> our list of untriaged bugs of this week:
<Ursinha> Soyuz (soyuz): 27
<Ursinha> launchpadlib  (launchpadlib): 25
<Ursinha> OOPS Tools (oops-tools): 16
<Ursinha> Launchpad Developer Utilities (lp-dev-utils): 9
<Ursinha> Launchpad Auto Build System (launchpad-buildd): 6
<Ursinha> Launchpad Development Wiki Moin theme (launchpad-dev-moin-theme): 5
<Ursinha> Launchpad Bazaar Integration (launchpad-code): 5
<Ursinha> Launchpad Bugs (malone): 5
<Ursinha> Launchpad Foundations (launchpad-foundations): 4
<Ursinha> Launchpad Translations (rosetta): 3
<Ursinha> Launchpad Buildbot Configuration (lpbuildbot): 2
<Ursinha> trac-launchpad-migrator (trac-launchpad-migrator): 2
<Ursinha> launchpad-loggerhead (launchpad-loggerhead): 2
<Ursinha> Launchpad News WordPress Theme (launchpad-news-wordpress-theme): 2
<Ursinha> Launchpad QA Utilities (lp-qa-tools): 2
<Ursinha> Launchpad Help Wiki Moin theme (launchpad-help-moin-theme): 2
<Ursinha> Launchpad CSCVS (launchpad-cscvs): 2
<Ursinha> Launchpad itself (launchpad): 1
<Ursinha> Launchpad Documentation (launchpad-documentation): 1
<Ursinha> Tickcount (tickcount): 1
<Ursinha> I see soyuz is looking much better now!
<Ursinha> rockstar, you have bugs this week :)
<rockstar> Ursinha, only one, and I have no idea how to just dismiss the bug like I want to.
<Ursinha> about the other projects, it would be nice to triage the bugs
* EdwinGrubbs (~egrubbs@70-239-164-128.lightspeed.snantx.sbcglobal.net) has joined #launchpad-meeting
* EdwinGrubbs has quit (Changing host)
* EdwinGrubbs (~egrubbs@canonical/launchpad/edwingrubbs) has joined #launchpad-meeting
<rockstar> It looks like everyone is doing well triaging.
<Ursinha> rockstar, yes, indeed
<Ursinha> I'm talking about the smaller projects
<Ursinha> like loggerhead, lp-buildd
<Ursinha> well, I'll poke people after the meeting about them :)
<gary_poster> consider launchpadlib poked
<Ursinha> [action] Ursinha to talk to people about the untriaged bugs of smaller projects
<MootBot> ACTION received:  Ursinha to talk to people about the untriaged bugs of smaller projects
<rockstar> Is loggerhead really the sole responsibility of Launchpad?  I thought it was generally a community project that we happened to be eating.
<Ursinha> gary_poster, thanks :)
<Ursinha> rockstar, that's a good question; those projects are the ones under the lp-project group
<Ursinha> rockstar, and that's exactly what I'd like to figure out, which ones we have to keep track of
<rockstar> Well, technically Tarmac should also be there (I think it's currently in the bazaar group, which is wrong)
<gary_poster> Ursinha: to really make me weep, you can include lazr.restfulclient, lazr.restful and wadllib in the list... :-) ...and probably other lazr.* packages
<rockstar> Ursinha, also, I think we want to disavow all knowledge of CSCVS one day.
<Ursinha> gary_poster, those ones aren't included in lp project, right?
<gary_poster> Ursinha: right.  You might be able to just point it to lazr project
* danilos has quit (Quit: Ex-Chat)
<gary_poster> Though that be a bad idea
<gary_poster> since it includes stuff like Storm
<Ursinha> [action] Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
<MootBot> ACTION received:  Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
<Ursinha> gary_poster, I'll send one email to lp list then we can discuss it better 
<gary_poster> cool, Ursinha
<Ursinha> [TOPIC] * Proposed items
<Ursinha> Anyone?
<MootBot> New Topic:  * Proposed items
<Ursinha> I'll consider that a no :)
<Ursinha> well
<Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
<Ursinha> happy Easter for those who have it :)
<Ursinha> #endmeeting