## Template for LP Production Meeting logs. Just paste xchat log below and the format IRC line will take care of formatting correctly
#format IRC
<matsubara> #startmeeting
<Ursinha> it seems our bot is gone
<matsubara> bot is missing
<matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
<matsubara> [TOPIC] Roll Call
<matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
<rockstar> me
<Ursinha> me!
<sinzui> me
<herb> me
<henninge> ich
<intellectronica> me
<noodles775> me
<henninge> does it have to be me?
<flacoste> me
<Ursinha> don't know
<henninge> since the bot is not here anyway ...
<rockstar> The bot annoyed me anyway.  I wanted to punch him out.
<matsubara> we're missing stub, he should be here in a moment. let's move on
<matsubara> [TOPIC] Agenda 
<matsubara>  * Next meeting
<matsubara>  * Actions from last meeting
<matsubara>  * Oops report & Critical Bugs 
<matsubara>  * QA pending items
<matsubara>  * Operations report (mthaddon/herb/spm)
<matsubara>  * DBA report (DBA contact)
<Ursinha> rockstar, you want to punch him because he's part of the nightmare of waking up early :P
<Ursinha> *it's
<matsubara> [TOPIC] * Next meeting
<matsubara> so same time next week?
<Ursinha> +1
<henninge> +1
<intellectronica> works for me
<rockstar> Ursinha: no, that's matsubara's fault...
<matsubara> [TOPIC] * Actions from last meeting
* IRSeekBot2 (n=IRSeekLo@irseek/log-bot/IRSeekBot) has joined #launchpad-meeting
<rockstar> :)
<noodles775> +1
* IRSeekBot2 has quit (K-lined)
<Ursinha> holy crap
<matsubara>  * matsubara to talk to ursinha about pending action items
<matsubara>     * Ursinha to talk to abentley about the status of bug 252807
<matsubara>     * Ursinha to watch for new occurrences of OOPS-1083H1147 the next hours/days (+newaccount timeout)
<matsubara>     * Ursinha and rockstar to talk to code people about 260171 and 252807
<matsubara>  * matsubara to file a bug about soyuz timeout oops OOPS-1083D1281 (ubuntu/+build timeout) and assign to al-maisan
<matsubara>  * herb to send Operations report to the list
<ubottu> Bug 252807 on http://launchpad.net/bugs/252807 is private
<ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083H1147
<ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083D1281
<Ursinha> all me
* herb failed.
<Ursinha> 1) just talked to abentley about bug 252807, he's working on it
<herb> but I'm here this week if it's any consolation
<ubottu> Bug 252807 on http://launchpad.net/bugs/252807 is private
<Ursinha> 2) didn't talk about the other bugs, rockstar, did you?
* stub (n=stub@canonical/launchpad/stub) has joined #launchpad-meeting
<rockstar> Yes!
<matsubara> I filed bug 315458 for the soyuz timeout one
<ubottu> Launchpad bug 315458 in soyuz "distro +builds page time out" [High,Triaged] https://launchpad.net/bugs/315458
<rockstar> There's no solution to them though, not yet anyway.
* noodles775 looks
<matsubara> welcome stub 
<noodles775> al-maisan hasn't yet added any info... I'll check with him about the above bug when he gets back from lunch...
<matsubara> thanks noodles775
<matsubara> anything else Ursinha ?
<Ursinha> matsubara, not for actions from last meeting
<matsubara> [TOPIC] * Oops report & Critical Bugs 
<Ursinha> right
<matsubara> Ursinha: stage is yours 
<Ursinha> so, there are two annoying bugs generating oopses, but they're fixed or the fix is on pqm
<Ursinha> so fine
<Ursinha> the critical bugs are fix committed, so fine too
<Ursinha> I have two oopses I'm investigating, but low occurrences, so will keep doing that in this afternoon
<Ursinha> my afternoon, that is
<Ursinha> well, nothing else
<matsubara> ok. thanks Ursinha 
<rockstar> Woot!  Hooray for fixing bugs.
<matsubara> [TOPIC] * QA pending items
<Ursinha> the same, the same
<matsubara> what is the same?
<Ursinha> matsubara, people need to qa the items :)
<Ursinha> rockstar, are you QAing your items?
* salgado is now known as salgado-lunch
* Notify: salgado is offline (niven.freenode.net).
<Ursinha> matsubara, the same is that the items are accumulating
<Ursinha> if help needed.... you know, poke us
<sinzui> No one like to QA my items :(
<rockstar> Ursinha, well, I haven't landed anything this cycle, so no.  I'll beat the rest of the team into submission though.
<Ursinha> rockstar, smart boy
<Ursinha> sinzui, do you want me to QA your items? :)
<Ursinha> if QAble for somebody else..
<Ursinha> anyone else needing help?
<sinzui> Ursinha: If you have time. My teams does not seem to have time...Some are more than week old
<Ursinha> sinzui, sure, I always can find some time to help QA
<matsubara> [action] matsubara and Ursinha to QA some of registry team items
<sinzui> Ursinha: The last one will require a LOSA to do, I will do it with him today...I think it is a chery pick candidate
<Ursinha> sinzui, right
<Ursinha> I'll check the items with you after the meeting
<Ursinha> alright
<Ursinha> rockstar, can you please ask code people to poke me so I can test stuff for them?
<Ursinha> pretty please?
<Ursinha> okay.. moving on
<Ursinha> thanks matsubara
<rockstar> Ursinha: some of their recent stuff will be pretty hard to test, but yeah.
<matsubara> thanks Ursinha
<matsubara> hard is good. builds character :-)
<matsubara> anyway, moving on
<matsubara> [TOPIC] * Operations report (mthaddon/herb/spm)
<herb> - Yesterday (2009-01-14) Cherry picked r7556 to fix bug 311690 and r7514 & r7562 to fix bugs 299997 & 316576.
<herb> https://bugs.edge.launchpad.net/launchpad-integration/+bug/311690
<ubottu> Launchpad bug 311690 in launchpad-foundations "Delay between blob submission and blob availability causes Launchpad to OOPS." [Critical,Fix released] https://launchpad.net/bugs/311690
<ubottu> Launchpad bug 299997 in soyuz "p3a can't build main packages against universe packages" [High,Fix released] https://launchpad.net/bugs/299997
<herb> https://bugs.edge.launchpad.net/soyuz/+bug/299997
<ubottu> Launchpad bug 311690 in launchpad-foundations "Delay between blob submission and blob availability causes Launchpad to OOPS." [Critical,Fix released]
<ubottu> Launchpad bug 299997 in soyuz "p3a can't build main packages against universe packages" [High,Fix released]
<herb> https://bugs.edge.launchpad.net/soyuz/+bug/316576
<ubottu> Launchpad bug 316576 in soyuz "P3As default dependencies don't include $distro-updates" [High,Fix released]
<herb> - Over the past week the vast majority of our incidents have been related to bug 156453 and/or bug 118625
<herb> https://bugs.edge.launchpad.net/loggerhead/+bug/156453
<ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/156453
<herb> https://bugs.edge.launchpad.net/launchpad-bazaar/+bug/118625
<ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/118625
<ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress]
<herb> - Once or twice a week we continue to see problems associated with bug 260171
<herb> https://bugs.edge.launchpad.net/launchpad-bazaar/+bug/260171
<ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged]
<herb> - 2009-01-13 - We had a load spike on the slave DB this week, which appeared to be related to some sort of bot abusing launchpad. We reverted half the app servers to connect to only the master DB which balanced to load and cleared up the timeouts we were seeing. We've since moved the app servers back to the slave DB.
<ubottu> Bug 260171 on http://launchpad.net/bugs/260171 is private
<ubottu> Error: This bug is private
<herb> whee!
* Ursinha got blind
<herb> I like it when ubottu doubles the size of my report.
<stub> herb: If load spikes are a regular issue, we could do that sort of load shifting dynamically. I wouldn't want the extra complexity though unless is really is required - a human pushing the button is probably the better option rather than letting the appservers decide.
<herb> figured when mootbot disappeared ubottu went with him.  anyway.
<herb> stub: for now, I think we prefer the human pushing the button
<herb> so that's it from the LOSAs unless there are any other questions/comments.
<matsubara> all right. thanks herb 
<matsubara> [TOPIC] * DBA report (DBA contact)
<stub> People are still recovering from the new year break, so all quiet on the db front.
<stub> Not much in the way of patches this cycle, assuming no last minute rush waiting for me in tomorrows email. Just file download counts, which should be a no brainer, and a rosetta patch that got bounced last cycle and needs a reply from Mark.
<stub> \
<matsubara> that was easy :-)
<matsubara> thanks stub 
<matsubara> anything else before I close?
<Ursinha> not from me
<matsubara> 3
<matsubara> 2
<matsubara> 1
<matsubara> Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs. 
* stub explodes
<rockstar> Thanks matsubara and Ursinha
<matsubara> #endmeeting