1 <Ursinha> #startmeeting
   2 <MootBot> Meeting started at 09:00. The chair is Ursinha.
   3 <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
   4 <sinzui> me
   5 <rockstar> me
   6 <Ursinha> haha
   7 <Ursinha> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
   8 <Ursinha> [TOPIC] Roll Call
   9 <Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
  10 <MootBot> New Topic:  Roll Call
  11 <Ursinha> now you can say mee
  12 <Ursinha> me
  13 <rockstar> me (again)
  14 <sinzui> me
  15 <intellectronica> meaux
  16 <Ursinha> erm
  17 * flacoste (n=francis@canonical/launchpad/flacoste) has joined #launchpad-meeting
  18 <flacoste> me
  19 <bigjools> me
  20 <Ursinha> who's missing
  21 <Ursinha> a losa?
  22 <intellectronica> stub?
  23 <Ursinha> herb, ping
  24 <matsubara_> I'm here
  25 <herb> me
  26 <matsubara_> me
  27 <Ursinha> stub is not here, it seems
  28 <Ursinha> flacoste, do you know anything about him?
  29 <flacoste> he's on leave
  30 <Ursinha> flacoste, oh, okay
  31 <matsubara_> [action] email stub asking for the DBA report
  32 <intellectronica> oh, so what's with db schema reviews?
  33 <Ursinha> [action] email stub asking for the DBA report
  34 <MootBot> ACTION received:  email stub asking for the DBA report
  35 <rockstar> matsubara_, you have no Priesthood with Mootbot!
  36 <Ursinha> well, flacoste, can you be stub's ears today?
  37 <matsubara_> yeah, not today :-)
  38 <Ursinha> eyes, in case
  39 <Ursinha> well
  40 <Ursinha> [TOPIC] Agenda
  41 <Ursinha>  * Next meeting
  42 <Ursinha>  * Actions from last meeting
  43 <Ursinha>  * Oops report & Critical Bugs 
  44 <Ursinha>  * QA pending items
  45 <Ursinha>  * Operations report (mthaddon/herb/spm)
  46 <Ursinha>  * DBA report (DBA contact)
  47 * thekorn (n=markus@a89-182-22-133.net-htp.de) has joined #launchpad-meeting
  48 <MootBot> New Topic:  Agenda
  49 <Ursinha> [TOPIC] * Next meeting
  50 <MootBot> New Topic:  * Next meeting
  51 * gary_poster has quit ()
  52 <Ursinha> okay for you?
  53 <Ursinha> same time and yada yada?
  54 <matsubara_> fine by me
  55 * henninge (n=henning@c146193.adsl.hansenet.de) has joined #launchpad-meeting
  56 <Ursinha> hi henninge :)
  57 <henninge> me!
  58 <matsubara_> hi henninge
  59 <Ursinha> cool
  60 <flacoste> Ursinha: yes, i'll proxy stuff to stub
  61 <intellectronica> some ppl may be in UDS? (not me)
  62 <Ursinha> so that's fine
  63 <Ursinha> flacoste, thanks
  64 <henninge> hi!
  65 <matsubara_> ok, any of the QA contacts will be attending UDS?
  66 <flacoste> not me
  67 <flacoste> not stub
  68 <bigjools> nope
  69 <henninge> not me, but the rest of my team
  70 <rockstar> no
  71 <Ursinha> henninge, but you're the QA contact, so whatever
  72 <Ursinha> :)
  73 <henninge> :)
  74 <Ursinha> ok, fine
  75 <matsubara_> sinzui: ?
  76 <sinzui> No I will not
  77 <Ursinha> [TOPIC] * Actions from last meeting
  78 <MootBot> New Topic:  * Actions from last meeting
  79 <matsubara_> ok, so same time next week
  80 <Ursinha> * gmb to add sql to hide bug 297388 as a fix for bug 300324
  81 <Ursinha> * abentley to talk to code team about bug 301595
  82 <Ursinha> * matsubara email losas to request operations report
  83 <Ursinha> * matsubara email stub to request dba report
  84 <ubottu> Error: Could not parse data returned by Launchpad: HTTP Error 500: Internal Server Error (https://launchpad.net/bugs/297388/+text)
  85 <ubottu> Launchpad bug 300324 in malone "Bug 297388 OOPSing because had its 0 comment deleted" [High,Triaged] https://launchpad.net/bugs/300324
  86 <ubottu> Launchpad bug 301595 in launchpad-bazaar "OOPS when deleting a branch with revisions" [High,Fix committed] https://launchpad.net/bugs/301595
  87 <Ursinha> uh-oh
  88 <Ursinha> damn bug
  89 <matsubara_> I did my two items and losas/stub emailed their reports to the list
  90 <Ursinha> matsubara_, nice, thanks
  91 <Ursinha> abentley must have talked with code people, that bug is fix committed
  92 <Ursinha> and intellectronica, do you know about bug 300324?
  93 <Ursinha> it's still triaged
  94 <intellectronica> i don't
  95 <Ursinha> well
  96 * intellectronica looking
  97 <intellectronica> the comment says it all
  98 <matsubara_> Ursinha, intellectronica: I'll chase that one. it's a simple SQL that needs approval to hide #297388
  99 <intellectronica> these are quite exceptional, so for now we're happy to deal with them on an individual basis
 100 <Ursinha> but it will be fixed, that's the point :)
 101 <Ursinha> thanks matsubara_ 
 102 <matsubara_> [action] matsubara to talk with gmb and add sql to hide bug 297388 as a fix for bug 300324
 103 <intellectronica> we already have the db infrastructure for dealing with this in a better way, but it's not the highest priority to finish that
 104 <ubottu> Error: Could not parse data returned by Launchpad: HTTP Error 500: Internal Server Error (https://launchpad.net/bugs/297388/+text)
 105 <ubottu> Launchpad bug 300324 in malone "Bug 297388 OOPSing because had its 0 comment deleted" [High,Triaged] https://launchpad.net/bugs/300324
 106 <Ursinha> [action] matsubara to talk with gmb and add sql to hide bug 2-9-7-3-8-8 as a fix for bug 300324
 107 <MootBot> ACTION received:  matsubara to talk with gmb and add sql to hide bug 2-9-7-3-8-8 as a fix for bug 300324
 108 <ubottu> Error: Launchpad bug 2 could not be found
 109 <ubottu> Error: Launchpad bug 2 could not be found
 110 <Ursinha> okay
 111 <Ursinha> [TOPIC] * QA pending items
 112 <MootBot> New Topic:  * QA pending items
 113 <Ursinha> well, I can see that there are lots of items to be tested on your testplans
 114 <Ursinha> are you having problems on testing them?
 115 <Ursinha> I
 116 <Ursinha> my fear is that we start to test it too late
 117 <matsubara_> [action] ursinha to add QA pending items topic to the MeetingPage agenda
 118 * salgado is now known as salgado-lunch
 119 <Ursinha> matsubara_, it's done already
 120 <intellectronica> some of the landings on our team are not really testable (some of the hwdb stuff). i'll see that the rest are tested promptly
 121 <matsubara_> Ursinha: all right. thanks
 122 <sinzui> Ursinha: Registry has been finding lots of bugs, so some of the items we are working on will not move to OK until we close the blocking bugs
 123 <Ursinha> so, rockstar, can you ask your team what can be done about that, please?
 124 <Ursinha> sinzui, that's okay, you have lots of tested items
 125 <rockstar> Ursinha, yup, making a note now.
 126 <Ursinha> rockstar, thanks
 127 <Ursinha> [action] rockstar to talk with code team about their pending QA items
 128 <MootBot> ACTION received:  rockstar to talk with code team about their pending QA items
 129 <Ursinha> okay
 130 <Ursinha> henninge, can you do the same too, please?
 131 <henninge> will do
 132 <Ursinha> thanks henninge 
 133 <Ursinha> [action] henninge  to talk with translation team about their pending QA items
 134 <MootBot> ACTION received:  henninge  to talk with translation team about their pending QA items
 135 <Ursinha> bigjools, what about you? 
 136 <Ursinha> souyz has a lot of items
 137 <bigjools> we've been QA-ing fine
 138 <bigjools> but they're arriving thick and fast again
 139 * bigjools will prod people
 140 <Ursinha> bigjools, it's true
 141 <Ursinha> how are you doing QA?
 142 <Ursinha> at the end of the week, on demand or what?
 143 <bigjools> when time allows after the branch lands
 144 <Ursinha> flacoste, sinzui, henninge, rockstar ^
 145 <Ursinha> intellectronica, ^
 146 <flacoste> like bigjools
 147 <Ursinha> bigjools, flacoste okay
 148 <sinzui> Ursinha: we are QAing a day after each landing
 149 <henninge> on demand
 150 <flacoste> ideally the day after it lands
 151 <intellectronica> we do it when we can
 152 <Ursinha> sinzui, awesome
 153 <flacoste> but unless i prompt people it doesn't happen
 154 <intellectronica> and try to remind each other that it's important to do
 155 <bigjools> flacoste: right, same here
 156 <flacoste> but this is really because we don't land that many QA-able changes
 157 <Ursinha> bigjools, flacoste, this is not quite that good
 158 <flacoste> most of work recently was on non front-end stuff
 159 <Ursinha> flacoste, I see you have only two items in there
 160 <Ursinha> so I understand
 161 <bigjools> Ursinha: it has to be balanced with other important stuff
 162 <intellectronica> sinzui's sounds like the sanest. i will suggest that we follow the same rule
 163 <bigjools> so it may go 2/3 days and then we'll clear them
 164 <Ursinha> bigjools, I understand, but as it's important too, I'd like to ask you please, please, to ask us help 
 165 <Ursinha> if we can test it for you, we'll do
 166 <bigjools> Ursinha: ok!  please test all our items ;)
 167 <sinzui> intellectronica: of course that assume staging *is* updating.
 168 <Ursinha> bigjools, ha ha
 169 <Ursinha> sinzui, yes, this is a major problem
 170 <intellectronica> sinzui: if we all adopt this rule, there will be many people on the case. sometimes staging doesn't update on purpose, but in most cases it just needs someone to care enough
 171 <Ursinha> in my opinion
 172 <bigjools> Ursinha: you might need an account on the dogfood machine to do some of them
 173 <Ursinha> bigjools, please, can we talk a bit about that later?
 174 <bigjools> Ursinha: sure
 175 <Ursinha> [action] Ursinha to talk with bigjools about one account on dogfood machine to do some testing
 176 <MootBot> ACTION received:  Ursinha to talk with bigjools about one account on dogfood machine to do some testing
 177 <Ursinha> great
 178 * matsubara (n=matsubar@canonical/launchpad/matsubara) has joined #launchpad-meeting
 179 <Ursinha> intellectronica, we're always watching if staging is updating
 180 <Ursinha> recently, at lease
 181 <Ursinha> least
 182 <intellectronica> cool
 183 <Ursinha> okay, so if there's something we can do, please poke us
 184 <Ursinha> so my beloved section of this meeting
 185 <Ursinha> [TOPIC] * Oops report & Critical Bugs
 186 <MootBot> New Topic:  * Oops report & Critical Bugs
 187 <Ursinha> well
 188 <Ursinha> I was going to mention the bug matsubara will look, that is the bug missing comment 0 one, ok
 189 <Ursinha> bug 271879
 190 <ubottu> Bug 271879 on http://launchpad.net/bugs/271879 is private
 191 * Ursinha looks at rockstar 
 192 <Ursinha> crap
 193 * matsubara_ has quit (Read error: 60 (Operation timed out))
 194 <Ursinha> rockstar, that is a timeout in +code-index page
 195 <Ursinha> still happening, yesterday we have a lot of timeout oopses, btw
 196 <Ursinha> not only in +code-index
 197 <rockstar> Ursinha, that might be on my list of things to do today, if the network will let me see the bug.
 198 <Ursinha> flacoste, do you think it can be related with the DB load problem?
 199 <Ursinha> rockstar, okay, thanks
 200 <Ursinha> [action] rockstar to handle bug 271879 today (12-04)
 201 <MootBot> ACTION received:  rockstar to handle bug 271879 today (12-04)
 202 <ubottu> Bug 271879 on http://launchpad.net/bugs/271879 is private
 203 <ubottu> Bug 271879 on http://launchpad.net/bugs/271879 is private
 204 <flacoste> the +code-index?
 205 <flacoste> it might
 206 <flacoste> but if it continues, probably not
 207 <Ursinha> flacoste, all the timeouts
 208 <rockstar> Yea, I got that oops yesterday, opened my big mouth, and got work to do as a reward.  :)
 209 <Ursinha> I mean, we had a lot of timeouts yesterday
 210 <flacoste> yeah, DB load increase the likelyhood of any timeout to happen
 211 <rockstar> Regardless, the query needs love.
 212 <Ursinha> for instance, +bugs-index page had 998 timeouts
 213 <Ursinha> on lpnet
 214 <Ursinha> will keep one eye on it
 215 <rockstar> Damn
 216 <Ursinha> well, will keep both, better
 217 <Ursinha> [action] Ursinha to watch timeouts in the next days to see if they continue to happen this often
 218 <MootBot> ACTION received:  Ursinha to watch timeouts in the next days to see if they continue to happen this often
 219 <Ursinha> cool
 220 <Ursinha> so this is all in the oops land
 221 <Ursinha> matsubara is faster copying and pasting stuff around
 222 <Ursinha> :)
 223 <Ursinha> so there's only that critical bug
 224 <Ursinha> bug 269538, that will never be closed
 225 <ubottu> Launchpad bug 269538 in bugzilla-launchpad/bugzilla-3.2 "Compliation error in plugin when authenticating" [Critical,Fix committed] https://launchpad.net/bugs/269538
 226 <Ursinha> matsubara, do you remember that from last meeting?
 227 <matsubara> Ursinha: gmb is chasing that with max
 228 <Ursinha> matsubara, okay
 229 <Ursinha> thanks
 230 <Ursinha> so the section is over
 231 <Ursinha> moving on
 232 <Ursinha> [TOPIC] * Operations report (mthaddon/herb/spm)
 233 <herb> Quiet week except for yesterday when the abusive user was slowing the system down.
 234 <Ursinha> hi herb
 235 <herb> - We're still rebooting codebrowse often as a result of bugs #156453 and #118625. I know it's being worked on, but there hasn't been an update to the bug reports in about a month.
 236 <herb> - Bug #301720 continues to be a problem requiring almost daily intervention from the LOSAs. We haven't seen an update on this one in the past week.
 237 <ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/156453
 238 <herb> hi
 239 <ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/118625
 240 <ubottu> Bug 301720 on http://launchpad.net/bugs/301720 is private
 241 <Ursinha> rockstar, beuno and you are looking at the loggerhead bug, right?
 242 <rockstar> Ursinha, yes, it's being discussed on list right now.
 243 <Ursinha> bug 301720
 244 <ubottu> Bug 301720 on http://launchpad.net/bugs/301720 is private
 245 <rockstar> There will probably be some work at UDS.
 246 <Ursinha> rockstar, nice to hear
 247 <Ursinha> about bug 301720, anybody?
 248 <ubottu> Bug 301720 on http://launchpad.net/bugs/301720 is private
 249 <herb> I think sinzui was working on it.
 250 <MootBot> New Topic:  * Operations report (mthaddon/herb/spm)
 251 <Ursinha> sinzui, can you do an update on that bug, please?
 252 <Ursinha> MootBot, you are slow, man
 253 <sinzui> Ursinha: it is in PQM now
 254 <Ursinha> sinzui, awesome :)
 255 <Ursinha> okay
 256 <Ursinha> anything else herb?
 257 <herb> nothing from me. thanks.
 258 <Ursinha> okay, rockstar, can you manage having something reported on those bugs, pretty please?
 259 <rockstar> Ursinha, doing that now.
 260 <Ursinha> rockstar, thanks!
 261 <Ursinha> [action] rockstar to manage having something reported on bug 118625 and bug 156453
 262 <MootBot> ACTION received:  rockstar to manage having something reported on bug 118625 and bug 156453
 263 <Ursinha> okay
 264 <ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/118625
 265 <ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/156453
 266 <Ursinha> moving on again
 267 <Ursinha> [TOPIC] * DBA report (DBA contact)
 268 <MootBot> New Topic:  * DBA report (DBA contact)
 269 <Ursinha> stub, that is
 270 <Ursinha> that's not here
 271 <Ursinha> and matsubara will mail him about his report
 272 <Ursinha> so
 273 <Ursinha> anyone have something to declare before I end all this?
 274 <flacoste> i have
 275 <flacoste> edge should run replicated as of tomorrow
 276 <flacoste> so watch out for any strange OOPS
 277 <Ursinha> flacoste, sure!
 278 <Ursinha> [action] Ursinha to watch for strange OOPSes on edge in the next days
 279 <MootBot> ACTION received:  Ursinha to watch for strange OOPSes on edge in the next days
 280 <Ursinha> anything else?
 281 * Ursinha looks at the clock
 282 <Ursinha> okay
 283 <Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs.
 284 <Ursinha> #endmeeting