## Template for LP Production Meeting logs. Just paste xchat log below and the format IRC line will take care of formatting correctly
#format IRC
<matsubara> #startmeeting
<MootBot> Meeting started at 10:00. The chair is matsubara.
<MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
<matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
<matsubara> [TOPIC] Roll Call 
<MootBot> New Topic:  Roll Call
<matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
<matsubara> Chex, gary_poster, rockstar, Ursinha, bigjools, danilos, sinzui1, allenap: hi
<sinzui1> me
<Ursinha> me
* sinzui1 is now known as sinzui
<danilos> me
<Chex> moi
<danilos> matsubara, hi :)
<bigjools> me, if it's faster than last week :)
<gary_poster> matsubara: on IS call as I mentioned.
<matsubara> gary_poster, all right. 
<gary_poster> matsubara: added notes to the two bugs that were my action items
<matsubara> thanks gary_poster 
<matsubara> so, let's move on, rockstar and allenap can join in along the way
<matsubara> [TOPIC] Agenda 
<MootBot> New Topic:  Agenda
<matsubara>  * Actions from last meeting
<matsubara>  * Oops report & Critical Bugs & Broken scripts
<matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
<matsubara>  * DBA report (stub)
<matsubara>  * Proposed items
<matsubara> [TOPIC] * Actions from last meeting
<MootBot> New Topic:  * Actions from last meeting
<matsubara>  * Ursinha to talk to mwhudson about bug 513412
<matsubara>  * rockstar to investigate OOPS-1480CMP1 and fill in details on bug 517126
<matsubara>  * gary_poster to check status on work for DisconnectionErrors (bug 450593) and assign bug 403618 to someone in foundations
<matsubara>  * Ursinha to set up StrategyTeamTestPlan wiki for jml,mrevell
<ubottu> Bug 513412 on http://launchpad.net/bugs/513412 is private
<ubottu> Launchpad bug 517126 in launchpad-code "BzrCheckError raised creating a merge proposal" [Undecided,New] https://launchpad.net/bugs/517126
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1480CMP1
<ubottu> Launchpad bug 450593 in launchpad-foundations "Still seeing non-informational DisconnectionErrors on login servers" [High,Triaged] https://launchpad.net/bugs/450593
<ubottu> Launchpad bug 403618 in launchpad-foundations "Launchpad should return a 404 instead of ForbiddenAttribute OOPS" [High,Triaged] https://launchpad.net/bugs/403618
<Ursinha> matsubara: I've set up the testplan for Strategy team
<matsubara> cool.
<Ursinha> matsubara: and I can't access the bug to see if I commented on it
<Ursinha> :/
<matsubara> and gary_poster commented on both bugs
<Ursinha> matsubara: I'll check
<matsubara> Ursinha, it's private for me too
<matsubara> Ursinha, ask one of the losas to subscribe the lp team to it
* mrjazzcat (~mrjazzcat@c-24-9-91-150.hsd1.co.comcast.net) has joined #launchpad-meeting
<Ursinha> matsubara: I'll do that
<matsubara> [action] * rockstar to investigate OOPS-1480CMP1 and fill in details on bug 517126
<ubottu> Launchpad bug 517126 in launchpad-code "BzrCheckError raised creating a merge proposal" [Undecided,New] https://launchpad.net/bugs/517126
<MootBot> ACTION received:  * rockstar to investigate OOPS-1480CMP1 and fill in details on bug 517126
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1480CMP1
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1480CMP1
<mrjazzcat> matsubara: whew, made it
<matsubara> hi mrjazzcat, welcome
<Ursinha> :)
<matsubara> Ursinha, shall I re-add the action item for the one you need to talk to mwhudson about?
<Ursinha> matsubara: please
<matsubara> [action] * Ursinha to talk to mwhudson about bug 513412
<MootBot> ACTION received:  * Ursinha to talk to mwhudson about bug 513412
<ubottu> Bug 513412 on http://launchpad.net/bugs/513412 is private
<ubottu> Bug 513412 on http://launchpad.net/bugs/513412 is private
<Ursinha> matsubara: as soon as I confirm I'll leave a comment there
<matsubara> ok, thanks
<matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
<MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
<Ursinha> okay
<Ursinha> so I'd like to bring up a timeout weirdness I saw, I've filed bug 523904 for that
<ubottu> Launchpad bug 523904 in malone "Distribution:+bugs timing out" [Undecided,New] https://launchpad.net/bugs/523904
<Ursinha> allenap: this bug is about a bunch of timeouts in Distro:+bugs
<Ursinha> allenap: but they apparently happened in a short period of time, and I couldn't find anything in the LP incident log
<Ursinha> allenap: could you take a look, please?
<matsubara> can you reproduce that bug Ursinha ?
<Ursinha> matsubara: not consistently
<matsubara> [action] allenap to investigate bug 523904 
<ubottu> Launchpad bug 523904 in malone "Distribution:+bugs timing out" [Undecided,New] https://launchpad.net/bugs/523904
<MootBot> ACTION received:  allenap to investigate bug 523904
<Ursinha> matsubara: but it times out from time to time and given the number of timeouts it would be great to investigate what happened
<sinzui> We are seeing a frequent timeouts on edge /ubuntu/lucid/+packaging and +needs-packaging. I reported a bug and will try to land a fix today
<Ursinha> thanks sinzui
<matsubara> any other oopses Ursinha ?
<Ursinha> the other bugs with most oopses are fix committed
<Ursinha> so, no
<matsubara> we have 4 critical bugs, all fix committed
<matsubara> yay!
<Ursinha> :)
<Ursinha> there are two scripts I've seen failing a couple of times lately
<Ursinha> productreleasefinder and allocate-revision-karma
<Ursinha> sinzui: do you know if prf one is legit?
<Ursinha> the failures, that is
<Ursinha> the other one I guess rockstar would be the best person to ask
<Ursinha> after that, I'm done
<sinzui> Ursinha: I am waiting to see if it fails again. It should be running right now
<Ursinha> sinzui: right
<Ursinha> matsubara: [action] Ursinha to ask rockstar about allocate-revision-karma failures
<matsubara> [action] Ursinha to ask rockstar about allocate-revision-karma failures
<MootBot> ACTION received:  Ursinha to ask rockstar about allocate-revision-karma failures
<matsubara> ok, let's move on
<matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
<MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
<Chex> hello everyone
<Chex> quick report this week:
<Chex> - DB Replication Lag/Slave-master issue: We are still running on the fake lag script pointing all traffic at
<sinzui> did edge just fall off the earth?
<Chex> the main production db. Has there been any new progress with this issue?
<Chex> - LP incidents of note:
<Chex>         ; Codebrowse restarts, we are getting better debugging info with mwhudson's help.
<Chex> anyone have any questions or comments?
<Ursinha> Chex: I have one request: could you subscribe lp team to bug 513412, please?
<ubottu> Bug 513412 on http://launchpad.net/bugs/513412 is private
<Chex> Ursinha: yes sure
<Ursinha> sinzui: what do you mean?
<Ursinha> Chex: thanks!
<sinzui> edge is slow, and users on #launchpad are reporting lots of timeouts. The I got a server is down from edge
<Chex> Ursinha: done
<Ursinha> Chex: great, thanks a lot
<Ursinha> sinzui: hm, it's working quite well here... anyone else noticing that?
<sinzui> I wonder if we have a bad server is rotation. I can have great loads and Please try again pages
<Ursinha> Chex: do you know if there's an incident going on?
<Chex> Ursinha: I am not seeing anything specific in our Lp monitoring, checking some more
<matsubara> ok, I guess we can move on and see if the timeouts are worrisome outside the meeting
<matsubara> thanks Chex, Ursinha and sinzui 
<matsubara> [TOPIC] * DBA report (stub)
<MootBot> New Topic:  * DBA report (stub)
<matsubara> I'll ask stub to email the report
<matsubara> [TOPIC] * Proposed items
<MootBot> New Topic:  * Proposed items
<matsubara> no new proposed items
<matsubara> anything else before I close?
<matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs. 
<matsubara> #endmeeting 
<MootBot> Meeting finished at 10:26.