#format IRC
<matsubara> #startmeeting
<MootBot> Meeting started at 10:00. The chair is matsubara.
<MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
<matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
<matsubara> [TOPIC] Roll Call 
<MootBot> New Topic:  Roll Call
<rockstar> ni!
<allenap> me
<mbarnett> whee!
<matsubara> Apologies from Ursinha and Stuart
<Chex> hello
<matsubara> gary_poster, bigjools_, danilo-afk2: ho
<matsubara> s/ho/hi/
<matsubara> sinzui, hi
<gary_poster> mo, me
<sinzui> me
<matsubara> ok, soyuz and translations are awol. let's move on and they can join later
<matsubara> [TOPIC] Agenda 
<MootBot> New Topic:  Agenda
<matsubara>  * Actions from last meeting
<matsubara>  * Oops report & Critical Bugs & Broken scripts
<matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
<matsubara>  * DBA report (stub)
<matsubara>  * Proposed items
<matsubara> [TOPIC] * Actions from last meeting
<MootBot> New Topic:  * Actions from last meeting
<matsubara>     * barry to continue debug on bug 403606 after finishing 3.0 UI stuff
<matsubara>     * intellectronica to take a look or find someone to take a look on bug 408738 after finishing 3.0 UI stuff
<matsubara>     * chex to trawl logs and add request that caused 500 error to bug 422960
<matsubara>         * spm added more info to the bug report
<matsubara>     * ursinha to file a bug for OOPS-1345G2533 and coordinate a fix with gary/stub
<matsubara>         * Filed bug 427397
<matsubara>     * matsubara to trawl logs related to high load on edge yesterday and ping Chex about it
<ubottu> Launchpad bug 403606 in launchpad-registry "ExpatError errors should be handled to not generate the OOPSes" [High,Triaged] https://launchpad.net/bugs/403606
<ubottu> Launchpad bug 408738 in malone "OOPS when rendering bug activity" [High,Triaged] https://launchpad.net/bugs/408738
<ubottu> Launchpad bug 422960 in launchpad-foundations "appear to be failing to record oops for all +translate HTTP 503 errors" [Undecided,New] https://launchpad.net/bugs/422960
<ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1345G2533
<ubottu> Launchpad bug 427397 in launchpad-foundations "Search triggering error in tsearch query again" [Low,Triaged] https://launchpad.net/bugs/427397
<sinzui> matsubara: I looked into Bug  403606. Still no progress. This needs barry and a losa on staging I think
<matsubara> [action]  * matsubara to trawl logs related to high load on edge yesterday and ping Chex about it
<MootBot> ACTION received:   * matsubara to trawl logs related to high load on edge yesterday and ping Chex about it
<matsubara> i still have to do that
<matsubara> sinzui, shall I re-add the action item? I'm assuming barry is still busy with 3.0 stuff?
* bigjools_ is now known as bigjools
<bigjools> me
<matsubara> hi bigjools, welcome
<bigjools> sorry I'm late
<sinzui> yes. I expect him to have time next week
<matsubara> cool. thanks
<matsubara> [action]  * barry to continue debug on bug 403606 after finishing 3.0 UI stuff
<MootBot> ACTION received:   * barry to continue debug on bug 403606 after finishing 3.0 UI stuff
<ubottu> Launchpad bug 403606 in launchpad-registry "ExpatError errors should be handled to not generate the OOPSes" [High,Triaged] https://launchpad.net/bugs/403606
<allenap> matsubara: None of the Bugs team has time right now to address bug 408738 sadly; we're all maxed out. I expect we won't get to this until after 3.0.
<ubottu> Launchpad bug 408738 in malone "OOPS when rendering bug activity" [High,Triaged] https://launchpad.net/bugs/408738
<matsubara> allenap, ok. I'll retarget to 3.1.10 then. do you want to keep the action item as reminder or should I remove it/
<allenap> matsubara: Remove it. If it's in the milestone it's reminder enough :)
<allenap> Thanks.
<matsubara> cool. thanks allenap 
<matsubara> let's move on
<matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
<MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
<matsubara> sinzui, can you take a look at https://bugs.edge.launchpad.net/launchpad-registry/+bug/429802 ?
<ubottu> Launchpad bug 429802 in launchpad-registry "Merged teams showing up in the web ui" [Undecided,Triaged]
<matsubara> sinzui, and assign/schedule it please
<matsubara> there was a bunch of DisconnectionErrors last week
<matsubara> which might be related to the outage we had
<sinzui> matsubara: We know what we are going to do with that. It the unassignment scheduler for deactivated and suspected accounts
<matsubara> sinzui, what's that?
<sinzui> There are several manifestations on this problem. the solution is a nightly cronjob that cleans up the teriary data left behind after the account was changed.
<matsubara> I see.
<matsubara> sinzui, looks like you have everything sorted :-)
<sinzui> matsubara: This will fix every where you see a deactivated person/team in a list
<matsubara> cool. so probably something for 3.1.10?
<sinzui> matsubara: yes, but then we started the release and redesign so I did no do it.
<sinzui> matsubara: I will create a spec today for it. I think 3.1.10 or 3.1.11
<matsubara> sinzui, thank you
<matsubara> On the critical bugs front, we have only one, which is fix committed
<matsubara> and on the scripts failures front
<matsubara> we have a bunch which failed this week :-(
<matsubara> the rosetta-poimport issue, which danilo is taking care of
<matsubara> checkwatches also hung and spm/gmb debugged and replied. it's all good now
<matsubara> process-pending-packagediffs which julian and cprov took care of with help from steve
<matsubara> and we now have a rosetta-approve-imports which is failing
<matsubara> probably related to the poimport failure
<matsubara> since danilo is not here, I'll ask him later
<danilo-afk2> matsubara, poimport has been fix released, approve imports unrelated to rosetta-approve-imports, and the latter should be fixed as well by now
<matsubara> [action] matsubara to ask danilo about rosetta-approve-imports failures
<MootBot> ACTION received:  matsubara to ask danilo about rosetta-approve-imports failures
<bigjools> fyi process-pending-packagediffs are caused by a bug in "diff" iteself!
<matsubara> hi danilo-afk2 
<danilo-afk2> hi, henninge was supposed to be here for the meeting, I am supposed to be afk
<matsubara> thanks for the update. it'd be awesome if you could reply to the Scripts failed to run: loganberry:rosetta-approve-imports email sent to the list      
<matsubara> danilo-afk2, I pinged both
* cprov has quit (Remote closed the connection)
<danilo-afk2> matsubara, I got sms from him that he forgot about it and went out, sorry for the lack of participation from translations, /me goes afk again
<matsubara> danilo-afk2, hmm ok. thanks
<matsubara> I think that's all for this section
<matsubara> thanks everyone
<matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
<MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
<Chex> hi everyone, here is our report for this week:
<Chex> - staging buildbot is now setup so we can test new  versions of buildbot in a sandbox
<Chex> - there have been ongoing discussions & plans to make codebrowse more reliable this week
<Chex> - poimport query caused Production DB disk issue on 11-Sep.  Bug: #408718 was applied to production on
<Chex> 15-Sep to fix the issue, poimport process was re-enabled after the fix applied.
<Chex> anyone have any questions?
* noodles775 has quit (Client Quit)
<matsubara> guess not. thanks Chex 
<matsubara> [TOPIC] * DBA report (stub)
<matsubara> nothing to report about the DB
<matsubara> [TOPIC] * Proposed items
<matsubara> no proposed items
<matsubara> anything else before I close?
<matsubara> 5
<matsubara> 4
<matsubara> 3
<matsubara> 2
<matsubara> 1
<matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs. 
<matsubara> #endmeeting 
* mbarnett chirps
* gary_poster notices the sound of the wind in the trees...
<gary_poster> or maybe that's the air conditioning...
<mthaddon> as always, losa concerns knock everyone over with their excitement levels
<mbarnett> nice work chex, you broke the meeting!
<bigjools> or put them to sleep
* noodles775 (n=miken@canonical/launchpad/noodles775) has joined #launchpad-meeting
<Chex> sorry all... :/
<gary_poster> yay losas for staging buildbot!
<gary_poster> matsubara: :-D ?
<MootBot> New Topic:  * DBA report (stub)
<MootBot> New Topic:  * Proposed items
<mthaddon> 1.5
<MootBot> Meeting finished at 10:28.