## Template for LP Production Meeting logs. Just paste xchat log below and the format IRC line will take care of formatting correctly
#format IRC
<matsubara> #startmeeting
<MootBot> Meeting started at 09:00. The chair is matsubara.
<MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
<matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
<matsubara> [TOPIC] Roll Call 
<MootBot> New Topic:  Roll Call
<al-maisan> me
<sinzui> me
<Ursinha> me
<matsubara> rockstar, Chex, allenap: hi
<al-maisan> brb
<allenap> me
* salgado is now known as salgado-lunch
<matsubara> ok, let's move on, others can join in along the way
<matsubara> [TOPIC] Agenda 
<MootBot> New Topic:  Agenda
<matsubara>  * Actions from last meeting
<matsubara>  * Oops report & Critical Bugs & Broken scripts
<matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
<matsubara>  * DBA report (stub)
<matsubara>  * Proposed items
<matsubara> [TOPIC] * Actions from last meeting
<MootBot> New Topic:  * Actions from last meeting
<matsubara>  * gary_poster to try to land branch that cherry picks lazr.restful updates on lpnet for bug 331990
<matsubara>  * Ursinha to ask matsubara about his outstanding items from last meeting
<matsubara>  * Ursinha to ask translations to triage bug 462891
<matsubara>     * Ursinha asked henninge in the meeting
<matsubara>  * allenap to follow up with pitti about bug 453203
<matsubara>  * Ursinha to send one email to lp list explaining the qa-tags experiment
<ubottu> Launchpad bug 331990 in launchpad-foundations "The inline editor widget reports a JSON error when saving non-ASCII characters" [High,Fix committed] https://launchpad.net/bugs/331990
<ubottu> Launchpad bug 462891 in rosetta "TraversalError on +export" [High,Triaged] https://launchpad.net/bugs/462891
<ubottu> Launchpad bug 453203 in apport "UnicodeDecodeError in +filebug: unexpected code byte" [Undecided,New] https://launchpad.net/bugs/453203
<Ursinha> also bug 462891 is being discussed in the ml
<allenap> Ehrm, I haven't done bug 453203 yet. Sorry, it's still on my list.
<Ursinha> and I started working on the wiki page to then send the email, but haven't finished
<Ursinha> will do
<Ursinha> [action] Ursinha to send one email to lp list explaining the qa-tags experiment
<matsubara> [action] Ursinha to send one email to lp list explaining the qa-tags experiment
<MootBot> ACTION received:  Ursinha to send one email to lp list explaining the qa-tags experiment
<matsubara> [action] allenap to follow up with pitti about bug 453203
<MootBot> ACTION received:  allenap to follow up with pitti about bug 453203
<ubottu> Launchpad bug 453203 in apport "UnicodeDecodeError in +filebug: unexpected code byte" [Undecided,New] https://launchpad.net/bugs/453203
<matsubara> the one from gary_poster is probably done now that we rolled out, right?
* matsubara tries to remember his outstanding items from the last meeting
<matsubara> * allenap and matsubara to talk about the timeouts on bug pages and * matsubara to talk to stub about the DBA report when he gets back
<sinzui> Ursinha: I reported bug 475433  oops leaving milestone code_name empty today. This edit form was broken by thumper's changes to StrippedTextLine last week.
<ubottu> Launchpad bug 475433 in launchpad-registry "oops leaving milestone code_name empty" [High,Triaged] https://launchpad.net/bugs/475433
* stub (n=stub@canonical/launchpad/stub) has joined #launchpad-meeting
<Ursinha> thanks sinziu
<stub> meep
<Ursinha> sinzui,
<matsubara> ok, I did talk to allenap about timeouts on bug pages
<allenap> matsubara: We didn't really come to any conclusions iirc.
<gary_poster> matsubara: yes, should be rolled out
<matsubara> and I sent an email to stub about the DBA report while he was on vacation
<stub> There is generally little to report about databases when I'm on vacation. I could send some holiday snaps if it would make people happy.
<matsubara> allenap, yeah. let's see if after this rollout timeouts will improve
<matsubara> stub, if it's like the one sinzui sent a long time ago, it'd be hilarious
<allenap> matsubara: Okay. I've back to Bugs as usual next week so I hope to have more time to look at this.
<matsubara> allenap, thanks
<matsubara> let's move on. thanks everyone
<sinzui> Does it involve hemorrhoid cream?
<matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
<MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
<Ursinha> LOL
<Ursinha> I'm not able to see the oopses from after the rollout yet due to an oops-tools problem, they're being generated since this morning, yet not finished
<Ursinha> the issues I'm aware are all being handled, scripts failing and this bug on milestone sinzui reported
<matsubara> we have one critical bug on launchpad-code which is in the New state
<matsubara> and rockstar is not around
<matsubara> the other one is on launchpad-foundations and it's fix committed
<Ursinha> sinzui, this milestone one is a candidate for reroll?
<sinzui> umm
<sinzui> I do not know. I suppose it is since I had to read the code to know that I had to enter a value to make my change work
<Ursinha> sinzui, if you think it's not :)
<sinzui> Ursinha: The fix is easy and I can get it reviewed today. It is certainly good for a CP
<Ursinha> sinzui, alright
<matsubara> thumper, if you're around can you update https://bugs.edge.launchpad.net/launchpad-code/+bug/475394 status and leave a comment explaining what's up and what's being done about it?
<Ursinha> I'd ask you if you are working on bugs for the reroll (if it happens), please tag your bugs with a current-rollout-blocker tag
<ubottu> Ubuntu bug 475394 in launchpad-code "bzr http access broken after 3.1.10 rollout" [Critical,New]
<noodles775> matsubara: abentley is currently working with mthaddon on #lp-code
* noodles775 goes again.
<matsubara> noodles775, thanks
<mthaddon> I was, but he quit on me :(
<matsubara> some scripts failing likely to be due to the rollout
<matsubara> garbo-hourly failing since some time ago due to https://bugs.edge.launchpad.net/launchpad-foundations/+bug/464161 and https://bugs.edge.launchpad.net/launchpad-foundations/+bug/464155
<ubottu> Ubuntu bug 464161 in launchpad-foundations "OpenIDAssociationPruner is using the wrong Store" [High,Confirmed]
<matsubara> stub, shouldn't the latter be more important than medium?
<stub> garbo isn't serious thankfully - we can cope.
<stub> other scripts might be affected by the same bug though (at least one has been reported), so it is my priority.
<matsubara> thanks stub 
<stub> (464161 is the priority - it might even be the cause of the other bug)
<matsubara> I see
<matsubara> Ursinha, anything else on this section?
<Ursinha> matsubara, no, not from me
<matsubara> thanks everyone
<matsubara> moving on
<matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
<MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
<mthaddon> LP rollout today, and some ongoing issues because of that (see "Cowboys" section of LPS)
<mthaddon> Can we get someone to review the IncidentLog and fill in the QA section?
<mthaddon> I think that's about it
<matsubara> [action] matsubara to talk to francis about the IncidentLog QA section
<MootBot> ACTION received:  matsubara to talk to francis about the IncidentLog QA section
<matsubara> thanks mthaddon 
<Ursinha> mthaddon, do you know if we're considering a reroll?
<Ursinha> maybe noodles775 know
<Ursinha> as he's the almighty release manager :)
<al-maisan> Ursinha: he's the *tired* RM :)
<mthaddon> we'll definitely need a reroll, as we already have a bunch of stuff cowboyed (per the LPS wiki page)
<Ursinha> https://wiki.canonical.com/InformationInfrastructure/OSA/LaunchpadProductionStatus
<Ursinha> to help who wants to see it :)
<Ursinha> anyway, I'll check up the oops today and see if we have serious issues that should be fixed before the reroll
<matsubara> thanks Ursinha 
<matsubara> let's move on
<matsubara> [TOPIC] * DBA report (stub)
<MootBot> New Topic:  * DBA report (stub)
<stub> Set to go with testing of the rosetta message sharing data migration. Looks like this might shrink the size of the big rosetta datasets by 30+%. W00t.
<stub> There are not many databases in Angkor, but my mother had a lovely time anyway.
<stub> The code that needed to land to get staging DB restores back under way landed. Early next week baring distractions I hope.
<stub> First test of the sanitized-database dump generator will be kicked off tomorrow.
<stub> It would be good if people can look over lib/lp/scripts/utilities/sanitizedb.py to see if I've missed anything in the sections of the schema they are familiar with. There should be a dump for Canonical devs to run on ec2 or at home if they are brave next week.
<stub> (The dumps should remain in company - there may be leaks in there now and because we use a blacklist approach, leaks can appear in the future. At least until teams have signed off on what we have and we have some sort of process for maintaining the tool).
<stub> oot.
<matsubara> [action] qa contacts to look into lib/lp/scripts/utilities/sanitizedb.py see if stub missed anything in the sections of the schema they are familiar with
<MootBot> ACTION received:  qa contacts to look into lib/lp/scripts/utilities/sanitizedb.py see if stub missed anything in the sections of the schema they are familiar with
<matsubara> stub, can you add one person from each team to the merge proposal that includes that script? that way people will look into it easily
<stub> Its already landed
<Ursinha> hehe, oops :)
<matsubara> ok, so the action stands for everyone, please pass the word to your teams
<stub> Anything people find has been missed is a bug. Anything removed that shouldn't be is a bug.
<matsubara> ok
<matsubara> let's move on
<stub> Its all simple to follow and in small, discreet steps.
<matsubara> cool. I'll also email the list to remind people
<matsubara> [action] matsubara to email the list about lib/lp/scripts/utilities/sanitizedb.py script 
<MootBot> ACTION received:  matsubara to email the list about lib/lp/scripts/utilities/sanitizedb.py script
<matsubara> thanks stub 
<matsubara> [TOPIC] * Proposed items
<MootBot> New Topic:  * Proposed items
<matsubara> no proposed items
<matsubara> anything else before I close
<matsubara> ?
<matsubara> 3
<matsubara> 2
<matsubara> 1
<matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs. 
<al-maisan> thanks
<matsubara> #endmeeting