## Just paste xchat log below and the format IRC line will take care of formatting correctly
#format IRC
<Ursinha> #startmeeting
<MootBot> Meeting started at 09:00. The chair is Ursinha.
<MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
<sinzui> me
<rockstar> me
<Ursinha> haha
<Ursinha> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
<Ursinha> [TOPIC] Roll Call
<Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
<MootBot> New Topic:  Roll Call
<Ursinha> now you can say mee
<Ursinha> me
<rockstar> me (again)
<sinzui> me
<intellectronica> meaux
<Ursinha> erm
* flacoste (n=francis@canonical/launchpad/flacoste) has joined #launchpad-meeting
<flacoste> me
<bigjools> me
<Ursinha> who's missing
<Ursinha> a losa?
<intellectronica> stub?
<Ursinha> herb, ping
<matsubara_> I'm here
<herb> me
<matsubara_> me
<Ursinha> stub is not here, it seems
<Ursinha> flacoste, do you know anything about him?
<flacoste> he's on leave
<Ursinha> flacoste, oh, okay
<matsubara_> [action] email stub asking for the DBA report
<intellectronica> oh, so what's with db schema reviews?
<Ursinha> [action] email stub asking for the DBA report
<MootBot> ACTION received:  email stub asking for the DBA report
<rockstar> matsubara_, you have no Priesthood with Mootbot!
<Ursinha> well, flacoste, can you be stub's ears today?
<matsubara_> yeah, not today :-)
<Ursinha> eyes, in case
<Ursinha> well
<Ursinha> [TOPIC] Agenda
<Ursinha>  * Next meeting
<Ursinha>  * Actions from last meeting
<Ursinha>  * Oops report & Critical Bugs 
<Ursinha>  * QA pending items
<Ursinha>  * Operations report (mthaddon/herb/spm)
<Ursinha>  * DBA report (DBA contact)
* thekorn (n=markus@a89-182-22-133.net-htp.de) has joined #launchpad-meeting
<MootBot> New Topic:  Agenda
<Ursinha> [TOPIC] * Next meeting
<MootBot> New Topic:  * Next meeting
* gary_poster has quit ()
<Ursinha> okay for you?
<Ursinha> same time and yada yada?
<matsubara_> fine by me
* henninge (n=henning@c146193.adsl.hansenet.de) has joined #launchpad-meeting
<Ursinha> hi henninge :)
<henninge> me!
<matsubara_> hi henninge
<Ursinha> cool
<flacoste> Ursinha: yes, i'll proxy stuff to stub
<intellectronica> some ppl may be in UDS? (not me)
<Ursinha> so that's fine
<Ursinha> flacoste, thanks
<henninge> hi!
<matsubara_> ok, any of the QA contacts will be attending UDS?
<flacoste> not me
<flacoste> not stub
<bigjools> nope
<henninge> not me, but the rest of my team
<rockstar> no
<Ursinha> henninge, but you're the QA contact, so whatever
<Ursinha> :)
<henninge> :)
<Ursinha> ok, fine
<matsubara_> sinzui: ?
<sinzui> No I will not
<Ursinha> [TOPIC] * Actions from last meeting
<MootBot> New Topic:  * Actions from last meeting
<matsubara_> ok, so same time next week
<Ursinha> * gmb to add sql to hide bug 297388 as a fix for bug 300324
<Ursinha> * abentley to talk to code team about bug 301595
<Ursinha> * matsubara email losas to request operations report
<Ursinha> * matsubara email stub to request dba report
<ubottu> Error: Could not parse data returned by Launchpad: HTTP Error 500: Internal Server Error (https://launchpad.net/bugs/297388/+text)
<ubottu> Launchpad bug 300324 in malone "Bug 297388 OOPSing because had its 0 comment deleted" [High,Triaged] https://launchpad.net/bugs/300324
<ubottu> Launchpad bug 301595 in launchpad-bazaar "OOPS when deleting a branch with revisions" [High,Fix committed] https://launchpad.net/bugs/301595
<Ursinha> uh-oh
<Ursinha> damn bug
<matsubara_> I did my two items and losas/stub emailed their reports to the list
<Ursinha> matsubara_, nice, thanks
<Ursinha> abentley must have talked with code people, that bug is fix committed
<Ursinha> and intellectronica, do you know about bug 300324?
<Ursinha> it's still triaged
<intellectronica> i don't
<Ursinha> well
* intellectronica looking
<intellectronica> the comment says it all
<matsubara_> Ursinha, intellectronica: I'll chase that one. it's a simple SQL that needs approval to hide #297388
<intellectronica> these are quite exceptional, so for now we're happy to deal with them on an individual basis
<Ursinha> but it will be fixed, that's the point :)
<Ursinha> thanks matsubara_ 
<matsubara_> [action] matsubara to talk with gmb and add sql to hide bug 297388 as a fix for bug 300324
<intellectronica> we already have the db infrastructure for dealing with this in a better way, but it's not the highest priority to finish that
<ubottu> Error: Could not parse data returned by Launchpad: HTTP Error 500: Internal Server Error (https://launchpad.net/bugs/297388/+text)
<ubottu> Launchpad bug 300324 in malone "Bug 297388 OOPSing because had its 0 comment deleted" [High,Triaged] https://launchpad.net/bugs/300324
<Ursinha> [action] matsubara to talk with gmb and add sql to hide bug 2-9-7-3-8-8 as a fix for bug 300324
<MootBot> ACTION received:  matsubara to talk with gmb and add sql to hide bug 2-9-7-3-8-8 as a fix for bug 300324
<ubottu> Error: Launchpad bug 2 could not be found
<ubottu> Error: Launchpad bug 2 could not be found
<Ursinha> okay
<Ursinha> [TOPIC] * QA pending items
<MootBot> New Topic:  * QA pending items
<Ursinha> well, I can see that there are lots of items to be tested on your testplans
<Ursinha> are you having problems on testing them?
<Ursinha> I
<Ursinha> my fear is that we start to test it too late
<matsubara_> [action] ursinha to add QA pending items topic to the MeetingPage agenda
* salgado is now known as salgado-lunch
<Ursinha> matsubara_, it's done already
<intellectronica> some of the landings on our team are not really testable (some of the hwdb stuff). i'll see that the rest are tested promptly
<matsubara_> Ursinha: all right. thanks
<sinzui> Ursinha: Registry has been finding lots of bugs, so some of the items we are working on will not move to OK until we close the blocking bugs
<Ursinha> so, rockstar, can you ask your team what can be done about that, please?
<Ursinha> sinzui, that's okay, you have lots of tested items
<rockstar> Ursinha, yup, making a note now.
<Ursinha> rockstar, thanks
<Ursinha> [action] rockstar to talk with code team about their pending QA items
<MootBot> ACTION received:  rockstar to talk with code team about their pending QA items
<Ursinha> okay
<Ursinha> henninge, can you do the same too, please?
<henninge> will do
<Ursinha> thanks henninge 
<Ursinha> [action] henninge  to talk with translation team about their pending QA items
<MootBot> ACTION received:  henninge  to talk with translation team about their pending QA items
<Ursinha> bigjools, what about you? 
<Ursinha> souyz has a lot of items
<bigjools> we've been QA-ing fine
<bigjools> but they're arriving thick and fast again
* bigjools will prod people
<Ursinha> bigjools, it's true
<Ursinha> how are you doing QA?
<Ursinha> at the end of the week, on demand or what?
<bigjools> when time allows after the branch lands
<Ursinha> flacoste, sinzui, henninge, rockstar ^
<Ursinha> intellectronica, ^
<flacoste> like bigjools
<Ursinha> bigjools, flacoste okay
<sinzui> Ursinha: we are QAing a day after each landing
<henninge> on demand
<flacoste> ideally the day after it lands
<intellectronica> we do it when we can
<Ursinha> sinzui, awesome
<flacoste> but unless i prompt people it doesn't happen
<intellectronica> and try to remind each other that it's important to do
<bigjools> flacoste: right, same here
<flacoste> but this is really because we don't land that many QA-able changes
<Ursinha> bigjools, flacoste, this is not quite that good
<flacoste> most of work recently was on non front-end stuff
<Ursinha> flacoste, I see you have only two items in there
<Ursinha> so I understand
<bigjools> Ursinha: it has to be balanced with other important stuff
<intellectronica> sinzui's sounds like the sanest. i will suggest that we follow the same rule
<bigjools> so it may go 2/3 days and then we'll clear them
<Ursinha> bigjools, I understand, but as it's important too, I'd like to ask you please, please, to ask us help 
<Ursinha> if we can test it for you, we'll do
<bigjools> Ursinha: ok!  please test all our items ;)
<sinzui> intellectronica: of course that assume staging *is* updating.
<Ursinha> bigjools, ha ha
<Ursinha> sinzui, yes, this is a major problem
<intellectronica> sinzui: if we all adopt this rule, there will be many people on the case. sometimes staging doesn't update on purpose, but in most cases it just needs someone to care enough
<Ursinha> in my opinion
<bigjools> Ursinha: you might need an account on the dogfood machine to do some of them
<Ursinha> bigjools, please, can we talk a bit about that later?
<bigjools> Ursinha: sure
<Ursinha> [action] Ursinha to talk with bigjools about one account on dogfood machine to do some testing
<MootBot> ACTION received:  Ursinha to talk with bigjools about one account on dogfood machine to do some testing
<Ursinha> great
* matsubara (n=matsubar@canonical/launchpad/matsubara) has joined #launchpad-meeting
<Ursinha> intellectronica, we're always watching if staging is updating
<Ursinha> recently, at lease
<Ursinha> least
<intellectronica> cool
<Ursinha> okay, so if there's something we can do, please poke us
<Ursinha> so my beloved section of this meeting
<Ursinha> [TOPIC] * Oops report & Critical Bugs
<MootBot> New Topic:  * Oops report & Critical Bugs
<Ursinha> well
<Ursinha> I was going to mention the bug matsubara will look, that is the bug missing comment 0 one, ok
<Ursinha> bug 271879
<ubottu> Bug 271879 on http://launchpad.net/bugs/271879 is private
* Ursinha looks at rockstar 
<Ursinha> crap
* matsubara_ has quit (Read error: 60 (Operation timed out))
<Ursinha> rockstar, that is a timeout in +code-index page
<Ursinha> still happening, yesterday we have a lot of timeout oopses, btw
<Ursinha> not only in +code-index
<rockstar> Ursinha, that might be on my list of things to do today, if the network will let me see the bug.
<Ursinha> flacoste, do you think it can be related with the DB load problem?
<Ursinha> rockstar, okay, thanks
<Ursinha> [action] rockstar to handle bug 271879 today (12-04)
<MootBot> ACTION received:  rockstar to handle bug 271879 today (12-04)
<ubottu> Bug 271879 on http://launchpad.net/bugs/271879 is private
<ubottu> Bug 271879 on http://launchpad.net/bugs/271879 is private
<flacoste> the +code-index?
<flacoste> it might
<flacoste> but if it continues, probably not
<Ursinha> flacoste, all the timeouts
<rockstar> Yea, I got that oops yesterday, opened my big mouth, and got work to do as a reward.  :)
<Ursinha> I mean, we had a lot of timeouts yesterday
<flacoste> yeah, DB load increase the likelyhood of any timeout to happen
<rockstar> Regardless, the query needs love.
<Ursinha> for instance, +bugs-index page had 998 timeouts
<Ursinha> on lpnet
<Ursinha> will keep one eye on it
<rockstar> Damn
<Ursinha> well, will keep both, better
<Ursinha> [action] Ursinha to watch timeouts in the next days to see if they continue to happen this often
<MootBot> ACTION received:  Ursinha to watch timeouts in the next days to see if they continue to happen this often
<Ursinha> cool
<Ursinha> so this is all in the oops land
<Ursinha> matsubara is faster copying and pasting stuff around
<Ursinha> :)
<Ursinha> so there's only that critical bug
<Ursinha> bug 269538, that will never be closed
<ubottu> Launchpad bug 269538 in bugzilla-launchpad/bugzilla-3.2 "Compliation error in plugin when authenticating" [Critical,Fix committed] https://launchpad.net/bugs/269538
<Ursinha> matsubara, do you remember that from last meeting?
<matsubara> Ursinha: gmb is chasing that with max
<Ursinha> matsubara, okay
<Ursinha> thanks
<Ursinha> so the section is over
<Ursinha> moving on
<Ursinha> [TOPIC] * Operations report (mthaddon/herb/spm)
<herb> Quiet week except for yesterday when the abusive user was slowing the system down.
<Ursinha> hi herb
<herb> - We're still rebooting codebrowse often as a result of bugs #156453 and #118625. I know it's being worked on, but there hasn't been an update to the bug reports in about a month.
<herb> - Bug #301720 continues to be a problem requiring almost daily intervention from the LOSAs. We haven't seen an update on this one in the past week.
<ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/156453
<herb> hi
<ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/118625
<ubottu> Bug 301720 on http://launchpad.net/bugs/301720 is private
<Ursinha> rockstar, beuno and you are looking at the loggerhead bug, right?
<rockstar> Ursinha, yes, it's being discussed on list right now.
<Ursinha> bug 301720
<ubottu> Bug 301720 on http://launchpad.net/bugs/301720 is private
<rockstar> There will probably be some work at UDS.
<Ursinha> rockstar, nice to hear
<Ursinha> about bug 301720, anybody?
<ubottu> Bug 301720 on http://launchpad.net/bugs/301720 is private
<herb> I think sinzui was working on it.
<MootBot> New Topic:  * Operations report (mthaddon/herb/spm)
<Ursinha> sinzui, can you do an update on that bug, please?
<Ursinha> MootBot, you are slow, man
<sinzui> Ursinha: it is in PQM now
<Ursinha> sinzui, awesome :)
<Ursinha> okay
<Ursinha> anything else herb?
<herb> nothing from me. thanks.
<Ursinha> okay, rockstar, can you manage having something reported on those bugs, pretty please?
<rockstar> Ursinha, doing that now.
<Ursinha> rockstar, thanks!
<Ursinha> [action] rockstar to manage having something reported on bug 118625 and bug 156453
<MootBot> ACTION received:  rockstar to manage having something reported on bug 118625 and bug 156453
<Ursinha> okay
<ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/118625
<ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/156453
<Ursinha> moving on again
<Ursinha> [TOPIC] * DBA report (DBA contact)
<MootBot> New Topic:  * DBA report (DBA contact)
<Ursinha> stub, that is
<Ursinha> that's not here
<Ursinha> and matsubara will mail him about his report
<Ursinha> so
<Ursinha> anyone have something to declare before I end all this?
<flacoste> i have
<flacoste> edge should run replicated as of tomorrow
<flacoste> so watch out for any strange OOPS
<Ursinha> flacoste, sure!
<Ursinha> [action] Ursinha to watch for strange OOPSes on edge in the next days
<MootBot> ACTION received:  Ursinha to watch for strange OOPSes on edge in the next days
<Ursinha> anything else?
* Ursinha looks at the clock
<Ursinha> okay
<Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs.
<Ursinha> #endmeeting