1 <Ursinha> #startmeeting
   2 <Ursinha> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
   3 <danilos> koo
   4 <MootBot> Meeting started at 11:00. The chair is Ursinha.
   5 <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
   6 <Ursinha> [TOPIC] Roll Call
   7 <Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
   8 <MootBot> New Topic:  Roll Call
   9 * rockstar  
  10 <Ursinha> me me
  11 <EdwinGrubbs> me
  12 * salgado is now known as salgado-lunch
  13 <matsubara> me
  14 <Ursinha> matsubara, Chex, bigjools, hello
  15 <Ursinha> :)
  16 <danilos> me
  17 <allenap> me
  18 * Ursinha throws a shoe on bigjools 
  19 * bigjools dodges the shoe and returns fire with a custard pie
  20 <Chex> me
  21 <Ursinha> so we're all here hehe
  22 <Ursinha> [TOPIC] Agenda
  23 <Ursinha>  * Actions from last meeting
  24 <Ursinha>  * Oops report & Critical Bugs & Broken scripts
  25 <Ursinha>  * Operations report (mthaddon/Chex/spm/mbarnett)
  26 <Ursinha>  * DBA report (stub)
  27 <Ursinha>  * QA stats of the week
  28 <Ursinha>  * Proposed items
  29 <MootBot> New Topic:  Agenda
  30 <Ursinha> [TOPIC] * Actions from last meeting
  31 <MootBot> New Topic:  * Actions from last meeting
  32 <Ursinha> * allenap to follow up with deryck about bug 230106
  33 <Ursinha> * gary_poster to triage bug 568456
  34 <Ursinha> * Chex to work with gary_poster or salgado to sort out how to use the meliae hooks to debug librarian and LP memory leaks
  35 <Ursinha> * matsubara to ask stub for the DBA report
  36 <Ursinha>     * Done.
  37 <Ursinha> * matsubara to update qa stats in the MeetingAgenda page
  38 <Ursinha>     * Done.
  39 <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
  40 <ubottu> Launchpad bug 568456 in launchpad-foundations "GpgmeError raised importing public gpg key" [Low,Triaged] https://launchpad.net/bugs/568456
  41 <Ursinha> bug 568456 is triaged, so done
  42 <Ursinha> I'll be talking about bug 230106 in the oops section
  43 <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
  44 <Ursinha> so, moving on
  45 <Ursinha> ah, not that fast, Chex, was your item sorted out?
  46 <Ursinha> Chex, hello :)
  47 <Chex> Ursinha: yes It was.. I will be notifying the losa's about the
  48 <Chex> proper procedure for crash-dump generation on the lp servers today
  49 <Ursinha> thanks Chex!
  50 <Ursinha> [TOPIC] * Oops report & Critical Bugs & Broken scripts
  51 <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
  52 <Chex> I touched base with salgado today
  53 <Ursinha> the most offenders are old ones
  54 <Ursinha> still a lot of oopses daily due to bug 553361
  55 <Ursinha> matsubara, do you know if that is going to be fixed in time for the rollout? 
  56 <Ursinha> this is really annoying and it's "tainting" oops summaries :/
  57 <ubottu> Launchpad bug 553361 in launchpad-foundations "OOPS when accessing launchpad with no referrer, eg. via wget" [High,Triaged] https://launchpad.net/bugs/553361
  58 <matsubara> Ursinha, it will not
  59  mars matsubara maxb mbarnett MootBot mrevell mthaddon mwhudson 
  60  mars matsubara maxb mbarnett MootBot mrevell mthaddon mwhudson 
  61 <Ursinha> matsubara, :(
  62 <Ursinha> matsubara, do you know if that can be fixed for a CP later then?
  63 <matsubara> Ursinha, always
  64 <Ursinha> matsubara, not much later :)
  65 <matsubara> I'll bring it up to gary on today's call
  66 <Ursinha> thanks a lot matsubara 
  67 <Ursinha> [action] matsubara to talk with gary_poster about  a CP for bug 553361
  68 <MootBot> ACTION received:  matsubara to talk with gary_poster about  a CP for bug 553361
  69 <ubottu> Launchpad bug 553361 in launchpad-foundations "OOPS when accessing launchpad with no referrer, eg. via wget" [High,Triaged] https://launchpad.net/bugs/553361
  70 <Ursinha> also, we're having about 270 oopses of the "None: None" kind (OOPS-1579CEMAIL1) on a daily basis
  71 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1579CEMAIL1
  72 <Ursinha> we cannot say what's the problem because the oops report is almost empty, and we'd need to fix bug 230106 to have more info
  73 <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
  74 <Ursinha> deryck said it won't be fixed soon, but I guess that given the number of oopses maybe we should try something to diagnose that problem
  75 <Ursinha> allenap, any suggestions?
  76 <allenap> Ursinha: I'll bump the bug up to High and explain why. It is scheduled to happen soon, this will make it happen sooner.
  77 <Ursinha> or anyone else
  78 <Ursinha> thanks a lot allenap 
  79 <matsubara> Ursinha, of course we know what's the problem
  80 <matsubara> it's bug 54005, isn't it?
  81 <ubottu> Launchpad bug 54005 in launchpad-foundations "bugs.launchpad.ubuntu.com email ending up in Launchpad mailbox" [Low,Triaged] https://launchpad.net/bugs/54005
  82 <Ursinha> matsubara, no, we're not sure because the bug is too old
  83 <matsubara> the fact they show up a None None is 230106
  84 <Ursinha> yes, that's what I said :) we need to fix 230106 in order to find out if the 270 oopses are really 54005
  85 <Ursinha> [action] allenap to bump bug 230106 to High and explain why
  86 <MootBot> ACTION received:  allenap to bump bug 230106 to High and explain why
  87 <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
  88 <matsubara> Ursinha, we don't need bug 230106 fixed to fix bug 54005
  89 <ubottu> Launchpad bug 54005 in launchpad-foundations "bugs.launchpad.ubuntu.com email ending up in Launchpad mailbox" [Low,Triaged] https://launchpad.net/bugs/54005
  90 <Ursinha> matsubara, read what I said again :)
  91 <matsubara> it's either 54005 is invalid because it's too old or we re-purpose it to fix OOPS-1579CEMAIL1
  92 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1579CEMAIL1
  93 <Ursinha> we're having a higher number of timeouts as well, about 800, and that doesn't seem to be specific to a part of launchpad
  94 <matsubara> I'm disagreeing that 230106 needs to fixed first
  95 <Ursinha> matsubara, I didn't say that we need to fix one to fix the other, I said we need to fix one to be able to see if the oopses are really the other
  96 <Ursinha> does anyone have a clue about the higher number of timeouts?
  97 <matsubara> and that's what I'm disagreeing about
  98 <Ursinha> matsubara, are you sure that oops is 54005?
  99 <Ursinha> not all oopses None None are bugs email
 100 <matsubara> pretty sure, but as I said, one doesn't need to be sure to fix OOPS-1579CEMAIL1
 101 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1579CEMAIL1
 102 <matsubara> yes, some are from the spec tracker
 103 <matsubara> which is also mentioned in the bug report
 104 <Ursinha> matsubara, we discussed that two meetings ago, I guess, that's where this conclusion came from
 105 <Ursinha> matsubara, but of course, you can discuss that bug with gary as well, that would be much appreciated :)
 106 <matsubara> ok
 107 <Ursinha> [action] matsubara to discuss bug 54005 with gary_poster
 108 <MootBot> ACTION received:  matsubara to discuss bug 54005 with gary_poster
 109 <ubottu> Launchpad bug 54005 in launchpad-foundations "bugs.launchpad.ubuntu.com email ending up in Launchpad mailbox" [Low,Triaged] https://launchpad.net/bugs/54005
 110 <Ursinha> bigjools, distributionmirror-prober script has failed twice today, is that under soyuz?
 111 <bigjools> Ursinha: registry
 112 <Ursinha> bigjools, thanks
 113 <Ursinha> EdwinGrubbs, do you know what's going on with distributionmirror-prober script, that failed twice today?
 114 <EdwinGrubbs> Ursinha: no, I don't know anything about it. can you point me at the error messages? I'll look into it.
 115 <Ursinha> EdwinGrubbs, sure, I'll do that as soon as the meeting finishes, thanks!
 116 <Ursinha> we have no critical bugs! yay!
 117 <Ursinha> I'm moving on
 118 <Ursinha> thanks guys
 119 <Ursinha> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
 120 <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
 121 * Ursinha hands Chex the mic
 122 <Ursinha> Chex, stage is empty, c'mon
 123 <Chex> hello everyone
 124 <danilos> hello Chex
 125 <Chex> it was a quiet week LP-wise as us LOSA's were in release prep all week.
 126 <Chex> I just have these incidents to report:
 127 <Chex>  - LP incidents of note: : 22-Apr: CP 9194 to librarian : 25-Apr: each app server on wampee using > 1.1G RSS - restarted
 128 <Chex> Does Anyone have any questions or comments for us?
 129 <Ursinha> anyone?
 130 <Ursinha> thanks Chex 
 131 <Ursinha> [TOPIC] * DBA report (stub)
 132 <MootBot> New Topic:  * DBA report (stub)
 133 <Ursinha> I sent one email to stub asking for the report
 134 <Ursinha> next :)
 135 <Ursinha> [TOPIC] * QA stats of the week
 136 <MootBot> New Topic:  * QA stats of the week
 137 <Ursinha> launchpadlib: 10
 138 <Ursinha> launchpad-buildd: 10
 139 <Ursinha> lp-dev-utils: 9
 140 <Ursinha> launchpad-dev-moin-theme: 6
 141 <Ursinha> launchpad-code: 5
 142 <Ursinha> soyuz: 4
 143 <Ursinha> malone: 4
 144 <Ursinha> launchpad-registry: 3
 145 <Ursinha> lp-qa-tools: 3
 146 <Ursinha> lpbuildbot: 2
 147 <Ursinha> trac-launchpad-migrator: 2
 148 <Ursinha> launchpad-news-wordpress-theme: 2
 149 <Ursinha> launchpad-help-moin-theme: 2
 150 <Ursinha> launchpad-cscvs: 2
 151 <Ursinha> launchpad-loggerhead: 1
 152 <Ursinha> launchpad-documentation: 1
 153 <Ursinha> tickcount: 1
 154 <Ursinha> so I guess we're doing pretty well triaging, those numbers look better every week
 155 <Ursinha> I'll triage the lp-qa-tools ones
 156 <bigjools> what are those numbers?
 157 <Ursinha> bigjools, untriaged bugs for each of those projects
 158 <Ursinha> bigjools, soyuz has 4 :)
 159 <Ursinha> [action] Ursinha to triage lp-qa-tools bugs
 160 <MootBot> ACTION received:  Ursinha to triage lp-qa-tools bugs
 161 <bigjools> QA stats evokes something else for me
 162 <Ursinha> bigjools, I agree with you :) why took you so long to say that? :)
 163 <bigjools> I was trying to say it in a way that wouldn't offend :)
 164 <bigjools> not sure I didn't fail
 165 <Ursinha> Untested items per team:
 166 <Ursinha> Code: 4
 167 <Ursinha> Foundations: 4
 168 <Ursinha> Registry: 2
 169 <Ursinha> Bugs: 6
 170 <Ursinha> Translations: 3
 171 <Ursinha> Soyuz: 7
 172 <Ursinha> Strategy: 1
 173 <bigjools>  /o\
 174 <Ursinha> bigjools, no, that's ok :) I'm asking because I guess we're having this section of the meeting for over a month now
 175 <Ursinha> bigjools, not sure that helped you :P
 176 <bigjools> :)
 177 <Ursinha> I'll try to come up with a better way to use that info here
 178 <Ursinha> but I can say that all teams are pretty good comparing to past cycles :)
 179 <Ursinha> I'm moving on then
 180 <Ursinha> bigjools, thanks :)
 181 <Ursinha> [TOPIC] * Proposed items
 182 <MootBot> New Topic:  * Proposed items
 183 <Ursinha> None
 184 <Ursinha> anyone wants to say something before this meeting closes?
 185 <Ursinha> ok then :)
 186 <Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
 187 <Ursinha> #endmeeting
 188 <MootBot> Meeting finished at 11:35.
 189 <Ursinha> thanks all, and happy Ubuntu release everyone!