1 <matsubara> #startmeeting
   2 <MootBot> Meeting started at 11:00. The chair is matsubara.
   3 <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
   4 <matsubara> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
   5 <matsubara> [TOPIC] Roll Call 
   6 <MootBot> New Topic:  Roll Call
   7 <matsubara> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us! 
   8 <sinzui> me
   9 <matsubara> Chex, gary_poster, bigjools, allenap, rockstar, danilos: Hi
  10 <gary_poster> me
  11 <bigjools> me sort of
  12 <danilos> me
  13 <Chex> me
  14 <allenap> me
  15 <matsubara> [TOPIC] Agenda 
  16 <MootBot> New Topic:  Agenda
  17 <matsubara>  * Actions from last meeting
  18 <matsubara>  * Oops report & Critical Bugs & Broken scripts
  19 <matsubara>  * Operations report (mthaddon/Chex/spm/mbarnett)
  20 <matsubara>  * DBA report (stub)
  21 <matsubara>  * QA stats of the week
  22 <matsubara>  * Proposed items
  23 <matsubara> [TOPIC] * Actions from last meeting
  24 <MootBot> New Topic:  * Actions from last meeting
  25 <matsubara>  * gary_poster and sinzui to discuss about the issues between master and slave that could be causing oopses
  26 <matsubara>  * allenap to follow up with deryck about bug 230106
  27 <matsubara>  * gary_poster to ask stub to investigate bug 556245
  28 <matsubara>  * Ursinha to send an email to stub asking for the dba report
  29 <matsubara>    * Done
  30 <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
  31 <ubottu> Error: Could not parse data returned by Launchpad: list index out of range (https://launchpad.net/bugs/556245)
  32 <sinzui> matsubara, done
  33 <matsubara> thanks sinzui 
  34 <gary_poster> matsubara: we have progress, in that meliae is installed thanks to salgado.  We're still at the diagnosis stage.
  35 <matsubara> thanks gary_poster 
  36 <gary_poster> we need to get the change CP'd.
  37 <matsubara> hwo about 556245?
  38 <allenap> matsubara: I suck, I'm sorry I didn't follow that up except to comment on the bug.
  39 <matsubara> allenap, any news about 230106
  40 <matsubara> ?
  41 <allenap> matsubara: See suckage above ^.
  42 <matsubara> hmm ok. shall I keep the action item?
  43 <allenap> matsubara: Yes please.
  44 <matsubara> [action] * allenap to follow up with deryck about bug 230106
  45 <MootBot> ACTION received:  * allenap to follow up with deryck about bug 230106
  46 <ubottu> Launchpad bug 230106 in malone "emails interface oops reports need better error messages" [Low,Triaged] https://launchpad.net/bugs/230106
  47 <matsubara> [TOPIC] * Oops report & Critical Bugs & Broken scripts
  48 <MootBot> New Topic:  * Oops report & Critical Bugs & Broken scripts
  49 <matsubara> I have two oops bugs: https://bugs.edge.launchpad.net/launchpad-registry/+bug/568459 which sinzui already duped (Thanks dude!)
  50 <ubottu> Ubuntu bug 568459 in launchpad-registry "LocationError raised browsing code of conduct page (dup-of: 555734)" [Undecided,New]
  51 <ubottu> Ubuntu bug 555734 in launchpad-registry "oops signing CoC if keys mutate" [High,Fix committed]
  52 <matsubara> gary_poster, and this one for foundations: https://bugs.edge.launchpad.net/launchpad-foundations/+bug/568456 
  53 <ubottu> Ubuntu bug 568456 in launchpad-foundations "GpgmeError raised importing public gpg key" [Undecided,New]
  54 <gary_poster> ack, matsubara thanks
  55 <matsubara> thanks gary_poster 
  56 <sinzui> Is this fixed in our tree now
  57 * sinzui does not see how lucid issue could be affecting hardy production
  58 <sinzui> but gpgme is a lucid/lp issue that I believe was fixed by salgado
  59 <matsubara> we had a couple of script failures, which spm already took care of
  60 <matsubara> we have no critical bugs open
  61 <matsubara> [action] gary_poster to triage bug 568456 
  62 <MootBot> ACTION received:  gary_poster to triage bug 568456
  63 <ubottu> Launchpad bug 568456 in launchpad-foundations "GpgmeError raised importing public gpg key" [Undecided,New] https://launchpad.net/bugs/568456
  64 <matsubara> let's move on, thanks everyone
  65 <matsubara> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
  66 <MootBot> New Topic:  * Operations report (mthaddon/Chex/spm/mbarnett)
  67 <Chex> hi everyone
  68 <Chex> here is the LOSA report for this week, just reporting on incidents this week:
  69 <Chex> - LP incidents of note:
  70 <Chex>         : 18-Apr:  swap problems on lpnet servers.  restarts on: lpnets 1,2,11,12,13,14,15 services; Bug: 531071
  71 <ubottu> Launchpad bug 531071 in launchpad-foundations "lpnet app servers are leaking memory again" [High,Triaged] https://launchpad.net/bugs/531071
  72 <Chex>         : 20-Apr: Checkwatches had hung, killed. Bug: 567088
  73 <ubottu> Launchpad bug 567088 in malone "checkwatches keeps hanging at irregular intervals" [Undecided,New] https://launchpad.net/bugs/567088
  74 <Chex>         : 21-Apr: crowberry h/w error, restarted the machine. OK for now, following up on the hardware issues.
  75 <Chex>         : 21-Apr: mizuho apparently OOMK'd, rebooted; necessitating full LP restart; Bug 556245
  76 <ubottu> Error: Could not parse data returned by Launchpad: list index out of range (https://launchpad.net/bugs/556245)
  77 <Chex> does anyone have any questions or comments on these?
  78 <gary_poster> Chex, are the LOSAs familiar with the steps necessary to use the meliae hooks?  I know salgado has been trying to communicate those via the right channels.
  79 <gary_poster> (this is pertinent to the memory leaks in librarian and LP)
  80 <matsubara> allenap, can you bring the checkwatches issue with your team?
  81 <matsubara> allenap, nm, I just noticed that you commented on the bug already, thanks! :-)
  82 <Chex> gary_poster: I was working with maliae breifly with the U1 team earlier this week, but I am unaware of the process for LP..
  83 <gary_poster> Chex, could you get back to me or salgado with the best way to communicate these changes to the LOSAs?  I know he has updated the wiki pages with instructions
  84 <gary_poster> (the LOSA wiki pages)
  85 <Chex> gary_poster: sorry, I see it now, thru his email to the LOSA list, I will look at that and make sure the rest of the team is aware of that, also.
  86 <gary_poster> Chex, thank you very much
  87 <matsubara> [action] Chex to work with gary_poster or salgado to sort out how to use the  meliae hooks to debug librarian and LP memory leaks
  88 <MootBot> ACTION received:  Chex to work with gary_poster or salgado to sort out how to use the  meliae hooks to debug librarian and LP memory leaks
  89 <Chex> gary_poster: that is the correct way to communicate those, but hilighting these issues to us in these meetings helps, too.
  90 <gary_poster> cool :-)
  91 <matsubara> thanks Chex and gary_poster 
  92 <matsubara> [TOPIC] * DBA report (stub)
  93 <MootBot> New Topic:  * DBA report (stub)
  94 <matsubara> I'll ask stub to send the report to the list
  95 <matsubara> [action] matsubara to ask stub for the DBA report
  96 <MootBot> ACTION received:  matsubara to ask stub for the DBA report
  97 <matsubara> [TOPIC] * QA stats of the week
  98 <MootBot> New Topic:  * QA stats of the week
  99 <matsubara> I don't have stats for this week. :-(
 100 <matsubara> sorry, I'll add them later to the MeetingAgenda page. need to find the script which generates it
 101 <matsubara> [action] matsubara to update qa stats in the MeetingAgenda page
 102 <MootBot> ACTION received:  matsubara to update qa stats in the MeetingAgenda page
 103 * gary_poster is happy because they would show shameful stats :-)  ...working on them now...
 104 <matsubara> hehe
 105 <matsubara> [TOPIC] * Proposed items
 106 <MootBot> New Topic:  * Proposed items
 107 <sinzui> gary_poster, I think everyone will see soyuz first
 108 <matsubara> no new proposed items
 109 <gary_poster> ok
 110 <matsubara> sinzui, soyuz cleared their untriaged queue last week
 111 * sinzui is shocked
 112 <matsubara> anything else before I close?
 113 <bigjools> feh
 114 <matsubara> :-)
 115 <matsubara> worst offenders are now foundations: launchpadlib and oops-tools
 116 <matsubara> actually no, oops-tools has 0 new untriaged. I cleared that a few weeks ago
 117 <matsubara> well, I guess that's it for today
 118 <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda  for the logs. 
 119 <matsubara> #endmeeting 
 120 <MootBot> Meeting finished at 11:19.