1 <matsubara> #startmeeting
   2 <Ursinha> it seems our bot is gone
   3 <matsubara> bot is missing
   4 <matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
   5 <matsubara> [TOPIC] Roll Call
   6 <matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
   7 <rockstar> me
   8 <Ursinha> me!
   9 <sinzui> me
  10 <herb> me
  11 <henninge> ich
  12 <intellectronica> me
  13 <noodles775> me
  14 <henninge> does it have to be me?
  15 <flacoste> me
  16 <Ursinha> don't know
  17 <henninge> since the bot is not here anyway ...
  18 <rockstar> The bot annoyed me anyway.  I wanted to punch him out.
  19 <matsubara> we're missing stub, he should be here in a moment. let's move on
  20 <matsubara> [TOPIC] Agenda 
  21 <matsubara>  * Next meeting
  22 <matsubara>  * Actions from last meeting
  23 <matsubara>  * Oops report & Critical Bugs 
  24 <matsubara>  * QA pending items
  25 <matsubara>  * Operations report (mthaddon/herb/spm)
  26 <matsubara>  * DBA report (DBA contact)
  27 <Ursinha> rockstar, you want to punch him because he's part of the nightmare of waking up early :P
  28 <Ursinha> *it's
  29 <matsubara> [TOPIC] * Next meeting
  30 <matsubara> so same time next week?
  31 <Ursinha> +1
  32 <henninge> +1
  33 <intellectronica> works for me
  34 <rockstar> Ursinha: no, that's matsubara's fault...
  35 <matsubara> [TOPIC] * Actions from last meeting
  36 * IRSeekBot2 (n=IRSeekLo@irseek/log-bot/IRSeekBot) has joined #launchpad-meeting
  37 <rockstar> :)
  38 <noodles775> +1
  39 * IRSeekBot2 has quit (K-lined)
  40 <Ursinha> holy crap
  41 <matsubara>  * matsubara to talk to ursinha about pending action items
  42 <matsubara>     * Ursinha to talk to abentley about the status of bug 252807
  43 <matsubara>     * Ursinha to watch for new occurrences of OOPS-1083H1147 the next hours/days (+newaccount timeout)
  44 <matsubara>     * Ursinha and rockstar to talk to code people about 260171 and 252807
  45 <matsubara>  * matsubara to file a bug about soyuz timeout oops OOPS-1083D1281 (ubuntu/+build timeout) and assign to al-maisan
  46 <matsubara>  * herb to send Operations report to the list
  47 <ubottu> Bug 252807 on http://launchpad.net/bugs/252807 is private
  48 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083H1147
  49 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083D1281
  50 <Ursinha> all me
  51 * herb failed.
  52 <Ursinha> 1) just talked to abentley about bug 252807, he's working on it
  53 <herb> but I'm here this week if it's any consolation
  54 <ubottu> Bug 252807 on http://launchpad.net/bugs/252807 is private
  55 <Ursinha> 2) didn't talk about the other bugs, rockstar, did you?
  56 * stub (n=stub@canonical/launchpad/stub) has joined #launchpad-meeting
  57 <rockstar> Yes!
  58 <matsubara> I filed bug 315458 for the soyuz timeout one
  59 <ubottu> Launchpad bug 315458 in soyuz "distro +builds page time out" [High,Triaged] https://launchpad.net/bugs/315458
  60 <rockstar> There's no solution to them though, not yet anyway.
  61 * noodles775 looks
  62 <matsubara> welcome stub 
  63 <noodles775> al-maisan hasn't yet added any info... I'll check with him about the above bug when he gets back from lunch...
  64 <matsubara> thanks noodles775
  65 <matsubara> anything else Ursinha ?
  66 <Ursinha> matsubara, not for actions from last meeting
  67 <matsubara> [TOPIC] * Oops report & Critical Bugs 
  68 <Ursinha> right
  69 <matsubara> Ursinha: stage is yours 
  70 <Ursinha> so, there are two annoying bugs generating oopses, but they're fixed or the fix is on pqm
  71 <Ursinha> so fine
  72 <Ursinha> the critical bugs are fix committed, so fine too
  73 <Ursinha> I have two oopses I'm investigating, but low occurrences, so will keep doing that in this afternoon
  74 <Ursinha> my afternoon, that is
  75 <Ursinha> well, nothing else
  76 <matsubara> ok. thanks Ursinha 
  77 <rockstar> Woot!  Hooray for fixing bugs.
  78 <matsubara> [TOPIC] * QA pending items
  79 <Ursinha> the same, the same
  80 <matsubara> what is the same?
  81 <Ursinha> matsubara, people need to qa the items :)
  82 <Ursinha> rockstar, are you QAing your items?
  83 * salgado is now known as salgado-lunch
  84 * Notify: salgado is offline (niven.freenode.net).
  85 <Ursinha> matsubara, the same is that the items are accumulating
  86 <Ursinha> if help needed.... you know, poke us
  87 <sinzui> No one like to QA my items :(
  88 <rockstar> Ursinha, well, I haven't landed anything this cycle, so no.  I'll beat the rest of the team into submission though.
  89 <Ursinha> rockstar, smart boy
  90 <Ursinha> sinzui, do you want me to QA your items? :)
  91 <Ursinha> if QAble for somebody else..
  92 <Ursinha> anyone else needing help?
  93 <sinzui> Ursinha: If you have time. My teams does not seem to have time...Some are more than week old
  94 <Ursinha> sinzui, sure, I always can find some time to help QA
  95 <matsubara> [action] matsubara and Ursinha to QA some of registry team items
  96 <sinzui> Ursinha: The last one will require a LOSA to do, I will do it with him today...I think it is a chery pick candidate
  97 <Ursinha> sinzui, right
  98 <Ursinha> I'll check the items with you after the meeting
  99 <Ursinha> alright
 100 <Ursinha> rockstar, can you please ask code people to poke me so I can test stuff for them?
 101 <Ursinha> pretty please?
 102 <Ursinha> okay.. moving on
 103 <Ursinha> thanks matsubara
 104 <rockstar> Ursinha: some of their recent stuff will be pretty hard to test, but yeah.
 105 <matsubara> thanks Ursinha
 106 <matsubara> hard is good. builds character :-)
 107 <matsubara> anyway, moving on
 108 <matsubara> [TOPIC] * Operations report (mthaddon/herb/spm)
 109 <herb> - Yesterday (2009-01-14) Cherry picked r7556 to fix bug 311690 and r7514 & r7562 to fix bugs 299997 & 316576.
 110 <herb> https://bugs.edge.launchpad.net/launchpad-integration/+bug/311690
 111 <ubottu> Launchpad bug 311690 in launchpad-foundations "Delay between blob submission and blob availability causes Launchpad to OOPS." [Critical,Fix released] https://launchpad.net/bugs/311690
 112 <ubottu> Launchpad bug 299997 in soyuz "p3a can't build main packages against universe packages" [High,Fix released] https://launchpad.net/bugs/299997
 113 <herb> https://bugs.edge.launchpad.net/soyuz/+bug/299997
 114 <ubottu> Launchpad bug 311690 in launchpad-foundations "Delay between blob submission and blob availability causes Launchpad to OOPS." [Critical,Fix released]
 115 <ubottu> Launchpad bug 299997 in soyuz "p3a can't build main packages against universe packages" [High,Fix released]
 116 <herb> https://bugs.edge.launchpad.net/soyuz/+bug/316576
 117 <ubottu> Launchpad bug 316576 in soyuz "P3As default dependencies don't include $distro-updates" [High,Fix released]
 118 <herb> - Over the past week the vast majority of our incidents have been related to bug 156453 and/or bug 118625
 119 <herb> https://bugs.edge.launchpad.net/loggerhead/+bug/156453
 120 <ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/156453
 121 <herb> https://bugs.edge.launchpad.net/launchpad-bazaar/+bug/118625
 122 <ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/118625
 123 <ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress]
 124 <herb> - Once or twice a week we continue to see problems associated with bug 260171
 125 <herb> https://bugs.edge.launchpad.net/launchpad-bazaar/+bug/260171
 126 <ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged]
 127 <herb> - 2009-01-13 - We had a load spike on the slave DB this week, which appeared to be related to some sort of bot abusing launchpad. We reverted half the app servers to connect to only the master DB which balanced to load and cleared up the timeouts we were seeing. We've since moved the app servers back to the slave DB.
 128 <ubottu> Bug 260171 on http://launchpad.net/bugs/260171 is private
 129 <ubottu> Error: This bug is private
 130 <herb> whee!
 131 * Ursinha got blind
 132 <herb> I like it when ubottu doubles the size of my report.
 133 <stub> herb: If load spikes are a regular issue, we could do that sort of load shifting dynamically. I wouldn't want the extra complexity though unless is really is required - a human pushing the button is probably the better option rather than letting the appservers decide.
 134 <herb> figured when mootbot disappeared ubottu went with him.  anyway.
 135 <herb> stub: for now, I think we prefer the human pushing the button
 136 <herb> so that's it from the LOSAs unless there are any other questions/comments.
 137 <matsubara> all right. thanks herb 
 138 <matsubara> [TOPIC] * DBA report (DBA contact)
 139 <stub> People are still recovering from the new year break, so all quiet on the db front.
 140 <stub> Not much in the way of patches this cycle, assuming no last minute rush waiting for me in tomorrows email. Just file download counts, which should be a no brainer, and a rosetta patch that got bounced last cycle and needs a reply from Mark.
 141 <stub> \
 142 <matsubara> that was easy :-)
 143 <matsubara> thanks stub 
 144 <matsubara> anything else before I close?
 145 <Ursinha> not from me
 146 <matsubara> 3
 147 <matsubara> 2
 148 <matsubara> 1
 149 <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs. 
 150 * stub explodes
 151 <rockstar> Thanks matsubara and Ursinha
 152 <matsubara> #endmeeting