1 <matsubara> #startmeeting
   2 <MootBot> Meeting started at 09:00. The chair is matsubara.
   3 <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
   4 <matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
   5 <matsubara> [TOPIC] Roll Call 
   6 <MootBot> New Topic:  Roll Call
   7 <al-maisan> me
   8 <sinzui> me
   9 <Ursinha> me
  10 <matsubara> rockstar, Chex, allenap: hi
  11 <al-maisan> brb
  12 <allenap> me
  13 * salgado is now known as salgado-lunch
  14 <matsubara> ok, let's move on, others can join in along the way
  15 <matsubara> [TOPIC] Agenda 
  16 <MootBot> New Topic:  Agenda
  17 <matsubara>  * Actions from last meeting
  18 <matsubara>  * Oops report & Critical Bugs & Broken scripts
  19 <matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
  20 <matsubara>  * DBA report (stub)
  21 <matsubara>  * Proposed items
  22 <matsubara> [TOPIC] * Actions from last meeting
  23 <MootBot> New Topic:  * Actions from last meeting
  24 <matsubara>  * gary_poster to try to land branch that cherry picks lazr.restful updates on lpnet for bug 331990
  25 <matsubara>  * Ursinha to ask matsubara about his outstanding items from last meeting
  26 <matsubara>  * Ursinha to ask translations to triage bug 462891
  27 <matsubara>     * Ursinha asked henninge in the meeting
  28 <matsubara>  * allenap to follow up with pitti about bug 453203
  29 <matsubara>  * Ursinha to send one email to lp list explaining the qa-tags experiment
  30 <ubottu> Launchpad bug 331990 in launchpad-foundations "The inline editor widget reports a JSON error when saving non-ASCII characters" [High,Fix committed] https://launchpad.net/bugs/331990
  31 <ubottu> Launchpad bug 462891 in rosetta "TraversalError on +export" [High,Triaged] https://launchpad.net/bugs/462891
  32 <ubottu> Launchpad bug 453203 in apport "UnicodeDecodeError in +filebug: unexpected code byte" [Undecided,New] https://launchpad.net/bugs/453203
  33 <Ursinha> also bug 462891 is being discussed in the ml
  34 <allenap> Ehrm, I haven't done bug 453203 yet. Sorry, it's still on my list.
  35 <Ursinha> and I started working on the wiki page to then send the email, but haven't finished
  36 <Ursinha> will do
  37 <Ursinha> [action] Ursinha to send one email to lp list explaining the qa-tags experiment
  38 <matsubara> [action] Ursinha to send one email to lp list explaining the qa-tags experiment
  39 <MootBot> ACTION received:  Ursinha to send one email to lp list explaining the qa-tags experiment
  40 <matsubara> [action] allenap to follow up with pitti about bug 453203
  41 <MootBot> ACTION received:  allenap to follow up with pitti about bug 453203
  42 <ubottu> Launchpad bug 453203 in apport "UnicodeDecodeError in +filebug: unexpected code byte" [Undecided,New] https://launchpad.net/bugs/453203
  43 <matsubara> the one from gary_poster is probably done now that we rolled out, right?
  44 * matsubara tries to remember his outstanding items from the last meeting
  45 <matsubara> * allenap and matsubara to talk about the timeouts on bug pages and * matsubara to talk to stub about the DBA report when he gets back
  46 <sinzui> Ursinha: I reported bug 475433  oops leaving milestone code_name empty today. This edit form was broken by thumper's changes to StrippedTextLine last week.
  47 <ubottu> Launchpad bug 475433 in launchpad-registry "oops leaving milestone code_name empty" [High,Triaged] https://launchpad.net/bugs/475433
  48 * stub (n=stub@canonical/launchpad/stub) has joined #launchpad-meeting
  49 <Ursinha> thanks sinziu
  50 <stub> meep
  51 <Ursinha> sinzui,
  52 <matsubara> ok, I did talk to allenap about timeouts on bug pages
  53 <allenap> matsubara: We didn't really come to any conclusions iirc.
  54 <gary_poster> matsubara: yes, should be rolled out
  55 <matsubara> and I sent an email to stub about the DBA report while he was on vacation
  56 <stub> There is generally little to report about databases when I'm on vacation. I could send some holiday snaps if it would make people happy.
  57 <matsubara> allenap, yeah. let's see if after this rollout timeouts will improve
  58 <matsubara> stub, if it's like the one sinzui sent a long time ago, it'd be hilarious
  59 <allenap> matsubara: Okay. I've back to Bugs as usual next week so I hope to have more time to look at this.
  60 <matsubara> allenap, thanks
  61 <matsubara> let's move on. thanks everyone
  62 <sinzui> Does it involve hemorrhoid cream?
  63 <matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
  64 <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
  65 <Ursinha> LOL
  66 <Ursinha> I'm not able to see the oopses from after the rollout yet due to an oops-tools problem, they're being generated since this morning, yet not finished
  67 <Ursinha> the issues I'm aware are all being handled, scripts failing and this bug on milestone sinzui reported
  68 <matsubara> we have one critical bug on launchpad-code which is in the New state
  69 <matsubara> and rockstar is not around
  70 <matsubara> the other one is on launchpad-foundations and it's fix committed
  71 <Ursinha> sinzui, this milestone one is a candidate for reroll?
  72 <sinzui> umm
  73 <sinzui> I do not know. I suppose it is since I had to read the code to know that I had to enter a value to make my change work
  74 <Ursinha> sinzui, if you think it's not :)
  75 <sinzui> Ursinha: The fix is easy and I can get it reviewed today. It is certainly good for a CP
  76 <Ursinha> sinzui, alright
  77 <matsubara> thumper, if you're around can you update https://bugs.edge.launchpad.net/launchpad-code/+bug/475394 status and leave a comment explaining what's up and what's being done about it?
  78 <Ursinha> I'd ask you if you are working on bugs for the reroll (if it happens), please tag your bugs with a current-rollout-blocker tag
  79 <ubottu> Ubuntu bug 475394 in launchpad-code "bzr http access broken after 3.1.10 rollout" [Critical,New]
  80 <noodles775> matsubara: abentley is currently working with mthaddon on #lp-code
  81 * noodles775 goes again.
  82 <matsubara> noodles775, thanks
  83 <mthaddon> I was, but he quit on me :(
  84 <matsubara> some scripts failing likely to be due to the rollout
  85 <matsubara> garbo-hourly failing since some time ago due to https://bugs.edge.launchpad.net/launchpad-foundations/+bug/464161 and https://bugs.edge.launchpad.net/launchpad-foundations/+bug/464155
  86 <ubottu> Ubuntu bug 464161 in launchpad-foundations "OpenIDAssociationPruner is using the wrong Store" [High,Confirmed]
  87 <matsubara> stub, shouldn't the latter be more important than medium?
  88 <stub> garbo isn't serious thankfully - we can cope.
  89 <stub> other scripts might be affected by the same bug though (at least one has been reported), so it is my priority.
  90 <matsubara> thanks stub 
  91 <stub> (464161 is the priority - it might even be the cause of the other bug)
  92 <matsubara> I see
  93 <matsubara> Ursinha, anything else on this section?
  94 <Ursinha> matsubara, no, not from me
  95 <matsubara> thanks everyone
  96 <matsubara> moving on
  97 <matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
  98 <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
  99 <mthaddon> LP rollout today, and some ongoing issues because of that (see "Cowboys" section of LPS)
 100 <mthaddon> Can we get someone to review the IncidentLog and fill in the QA section?
 101 <mthaddon> I think that's about it
 102 <matsubara> [action] matsubara to talk to francis about the IncidentLog QA section
 103 <MootBot> ACTION received:  matsubara to talk to francis about the IncidentLog QA section
 104 <matsubara> thanks mthaddon 
 105 <Ursinha> mthaddon, do you know if we're considering a reroll?
 106 <Ursinha> maybe noodles775 know
 107 <Ursinha> as he's the almighty release manager :)
 108 <al-maisan> Ursinha: he's the *tired* RM :)
 109 <mthaddon> we'll definitely need a reroll, as we already have a bunch of stuff cowboyed (per the LPS wiki page)
 110 <Ursinha> https://wiki.canonical.com/InformationInfrastructure/OSA/LaunchpadProductionStatus
 111 <Ursinha> to help who wants to see it :)
 112 <Ursinha> anyway, I'll check up the oops today and see if we have serious issues that should be fixed before the reroll
 113 <matsubara> thanks Ursinha 
 114 <matsubara> let's move on
 115 <matsubara> [TOPIC] * DBA report (stub)
 116 <MootBot> New Topic:  * DBA report (stub)
 117 <stub> Set to go with testing of the rosetta message sharing data migration. Looks like this might shrink the size of the big rosetta datasets by 30+%. W00t.
 118 <stub> There are not many databases in Angkor, but my mother had a lovely time anyway.
 119 <stub> The code that needed to land to get staging DB restores back under way landed. Early next week baring distractions I hope.
 120 <stub> First test of the sanitized-database dump generator will be kicked off tomorrow.
 121 <stub> It would be good if people can look over lib/lp/scripts/utilities/sanitizedb.py to see if I've missed anything in the sections of the schema they are familiar with. There should be a dump for Canonical devs to run on ec2 or at home if they are brave next week.
 122 <stub> (The dumps should remain in company - there may be leaks in there now and because we use a blacklist approach, leaks can appear in the future. At least until teams have signed off on what we have and we have some sort of process for maintaining the tool).
 123 <stub> oot.
 124 <matsubara> [action] qa contacts to look into lib/lp/scripts/utilities/sanitizedb.py see if stub missed anything in the sections of the schema they are familiar with
 125 <MootBot> ACTION received:  qa contacts to look into lib/lp/scripts/utilities/sanitizedb.py see if stub missed anything in the sections of the schema they are familiar with
 126 <matsubara> stub, can you add one person from each team to the merge proposal that includes that script? that way people will look into it easily
 127 <stub> Its already landed
 128 <Ursinha> hehe, oops :)
 129 <matsubara> ok, so the action stands for everyone, please pass the word to your teams
 130 <stub> Anything people find has been missed is a bug. Anything removed that shouldn't be is a bug.
 131 <matsubara> ok
 132 <matsubara> let's move on
 133 <stub> Its all simple to follow and in small, discreet steps.
 134 <matsubara> cool. I'll also email the list to remind people
 135 <matsubara> [action] matsubara to email the list about lib/lp/scripts/utilities/sanitizedb.py script 
 136 <MootBot> ACTION received:  matsubara to email the list about lib/lp/scripts/utilities/sanitizedb.py script
 137 <matsubara> thanks stub 
 138 <matsubara> [TOPIC] * Proposed items
 139 <MootBot> New Topic:  * Proposed items
 140 <matsubara> no proposed items
 141 <matsubara> anything else before I close
 142 <matsubara> ?
 143 <matsubara> 3
 144 <matsubara> 2
 145 <matsubara> 1
 146 <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs. 
 147 <al-maisan> thanks
 148 <matsubara> #endmeeting