1 <matsubara> #startmeeting
   2 <MootBot> Meeting started at 09:00. The chair is matsubara.
   3 <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
   4 * flacoste (n=francis@canonical/launchpad/flacoste) has joined #launchpad-meeting
   5 <danilos> me
   6 <sinzui> me
   7 <rockstar> me
   8 * bigjools (n=ed@canonical/launchpad/bigjools) has joined #launchpad-meeting
   9 * stub (n=stub@canonical/launchpad/stub) has joined #launchpad-meeting
  10 <danilos> and now, who's here?
  11 <bigjools> me
  12 <stub> me
  13 <intellectronica> me
  14 <matsubara> me
  15 <herb> me
  16 <matsubara> [TOPIC] Roll Call 
  17 <MootBot> New Topic:  Roll Call
  18 * mwhudson has quit (Read error: 110 (Connection timed out))
  19 <matsubara> oops, forgot to change it to the right topic
  20 <mrevell> me
  21 <matsubara> Ursinha, ?
  22 <matsubara> flacoste,
  23 <Ursinha> me
  24 <flacoste> me
  25 <Ursinha> sorry
  26 <matsubara> ok, everyone seems to be here. let's move on
  27 <matsubara> [TOPIC] Agenda
  28 <MootBot> New Topic:  Agenda
  29 <matsubara> * Next meeting
  30 <matsubara>  * Actions from last meeting
  31 <matsubara>  * Oops report & Critical Bugs 
  32 <matsubara>  * Operations report (mthaddon/herb/spm)
  33 <matsubara>  * DBA report (DBA contact)
  34 <matsubara> so, next meeting, same time next week?
  35 <Ursinha> +1
  36 <danilos> +1
  37 <matsubara> all right. so be it
  38 <matsubara> [topic] actions from last meeting
  39 <MootBot> New Topic:  actions from last meeting
  40 <rockstar> It's early for me, but that's alright I guess.
  41 <matsubara> * intellectronica to continue diagnosing bug 279561
  42 <matsubara> * intellectronica to discuss bug 95822 (app server core dump bug) with Bugs team and try to find a quick workaround 
  43 <matsubara> * matsubara update core dump bug with progress made last week
  44 <matsubara> * herb to find or file a bug about codebrowse being unresponsive and needing restarts
  45 <ubottu> Launchpad bug 279561 in malone "No url for <Message at ...> when trying to access bug messages through the API" [High,Incomplete] https://launchpad.net/bugs/279561
  46 <ubottu> Launchpad bug 95822 in apport "Malone  connection generates an "Internal Server Error" on large file attachments" [Medium,Confirmed] https://launchpad.net/bugs/95822
  47 <matsubara> I think I did the progress update
  48 <intellectronica> matsubara: i think bjorn is dealing with 95822, i don't know the status, though
  49 <herb> Codebrowse bug(s): Bug #118625 and Bug #156453
  50 <ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Confirmed] https://launchpad.net/bugs/118625
  51 <ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,Confirmed] https://launchpad.net/bugs/156453
  52 <matsubara> thanks herb
  53 <intellectronica> 279561 is a data issue, and the priority is low, since it's very rare, and we haven't seen any recent oopses
  54 <matsubara> intellectronica, can you update the bug report with the importance + rationale?
  55 <intellectronica> matsubara: sure, will do
  56 <matsubara> thanks intellectronica 
  57 <matsubara> all right, moving on
  58 <matsubara> [topic]  * Oops report & Critical Bugs 
  59 <MootBot> New Topic:   * Oops report & Critical Bugs
  60 <matsubara> Ursinha, take the stage please
  61 <Ursinha> look ma, that's me!
  62 <Ursinha> hi guys
  63 <Ursinha> Have three bugs
  64 <Ursinha> bug 286401, bug 294689, bug 294719
  65 * rockstar hopes they aren't for code.
  66 <ubottu> Launchpad bug 286401 in launchpad-registry "Contact this user OOPSes when displayname has non-ASCII" [High,Triaged] https://launchpad.net/bugs/286401
  67 <ubottu> Launchpad bug 294689 in malone "OOPS passing order_by=datecreated parameter to API searchTasks" [Undecided,Triaged] https://launchpad.net/bugs/294689
  68 <ubottu> Launchpad bug 294719 in launchpad-registry "OOPS when trying to subscribe a private team to a bug" [Undecided,New] https://launchpad.net/bugs/294719
  69 <Ursinha> cool
  70 <Ursinha> so, the first one, I think barry is taking care, but not sure
  71 <danilos> rockstar: most bugs are for code :P
  72 <rockstar> danilos, :)
  73 <Ursinha> it's annoying and very easy to reproduce :/
  74 <danilos> Ursinha: have you tried contacting me?
  75 <Ursinha> sinzui, do you know if barry is taking care of that?
  76 <intellectronica> Ursinha: i'll take 294689, of course
  77 <Ursinha> intellectronica, great, thanks
  78 <Ursinha> about bug 294719
  79 <ubottu> Launchpad bug 294719 in launchpad-registry "OOPS when trying to subscribe a private team to a bug" [Undecided,New] https://launchpad.net/bugs/294719
  80 <sinzui> 286401 will be in review today
  81 <stub> It is assigned to barry and scheduled for this cycle, so I guess he is handling it.
  82 <Ursinha> sinzui, ok, thanks
  83 <intellectronica> Ursinha: and i'll either take or try to find someone to deal with 294719
  84 <Ursinha> intellectronica, nice! I've discussed it briefly yesterday with bac and EdwinGrubbs
  85 <Ursinha> it was an "accident", but happened again, so needs some love
  86 <Ursinha> :)
  87 <intellectronica> unless someone from registry already knows more about it and wants to deal with it :)
  88 <Ursinha> sinzui, ?
  89 <sinzui> I think I can pass 294719 to Edwin
  90 <intellectronica> sinzui: cool, thanks
  91 <sinzui> or possibly salgado
  92 * sinzui targets bug
  93 <Ursinha> danilos, now I understood your question :P I didn't, but it'd oops for sure
  94 <Ursinha> great, thanks sinzui
  95 <Ursinha> ok guys, that's all from oops land
  96 * salgado is now known as salgado-lunch
  97 <matsubara> thanks Ursinha.
  98 <matsubara> we have 1 critical bug report which is fix committed
  99 <Ursinha> no critical bugs, so fine
 100 <Ursinha> yes
 101 <matsubara> so, moving on
 102 <Ursinha> thanks matsubara
 103 <matsubara> thanks guys
 104 <Ursinha> thanks guys
 105 <matsubara> [topic] * Operations report (mthaddon/herb/spm)
 106 <MootBot> New Topic:  * Operations report (mthaddon/herb/spm)
 107 <herb> - 2008-10-16 -- Had a service affecting issue related to proxied requests using HTTP/1.1 vs. HTTP/1.0
 108 <herb> - 2008-10-17 -- Rolled out r7188 to production
 109 <herb> - 2008-10-20 -- Finally isolated and fixed the issues relating to proxied requests that affected is on 2008-10-16 and again on 2008-10-20
 110 <herb> - 2008-10-20 -- Cherry pick r7204
 111 <herb> - 2008-10-29 -- Cherry pick fix for bug #289661 and a fix for the mirror prober
 112 <herb> - 2008-11-04 -- Cherry pick r7226 and r7231
 113 <ubottu> Launchpad bug 289661 in launchpad-bazaar ""Active code reviews" page returns oops in "live" LP (not edge)" [High,Triaged] https://launchpad.net/bugs/289661
 114 <herb> - 2008-11-05 -- Cherry pick r7219
 115 <herb> - We continue to be affected by the codebrowse bugs several times a week. See bug #118625 and bug #156453.
 116 <ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Confirmed] https://launchpad.net/bugs/118625
 117 <ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,Confirmed] https://launchpad.net/bugs/156453
 118 <herb> that's it from us unless there are questions.
 119 <rockstar> herb, we worked on loggerhead this last two weeks.  I think we've narrowed the problem down, and can get a good idea what's going on.
 120 <herb> rockstar: good to know. thanks.
 121 <rockstar> Er, have a good idea what needs fixing.
 122 <stub> Leonard will be in contact to discuss why certain HTTP headers are being seen on production and not on staging, breaking Launchpad APIs on staging.
 123 <herb> stub: ok
 124 <matsubara> rockstar, can you assign those bugs to someone in your team and add a small comment on their status for everyone else benefit?
 125 <rockstar> matsubara, yes, doing it now.
 126 <herb> stub: he queried me right before the meeting.
 127 <matsubara> thank you rockstar
 128 <matsubara> anything else for the LOSAS?
 129 <matsubara> all right, moving on. thanks herb 
 130 <herb> thanks
 131 <matsubara> [topic] * DBA report (DBA contact)
 132 <MootBot> New Topic:  * DBA report (DBA contact)
 133 <stub> Staging is now running replicated. I managed to track down the variable that triggered the replica subscription failures. Our idle connection reaper was detecting one of the slony connections as evil and killing it, and Slony didn't report this in any meaningful way or abort the operation that could no longer be completed.
 134 <stub> I've added a whitelist facility to our reaper and installed it into production and staging. I've opened a bug upstream - I suspect it will be a WONTFIX, but the information should be useful to others when they get bitten (the error message we where seeing is reported on the mailing list about once per month, but no help there apart from retrying until it works).
 135 <stub> I think we are still on track to make production replicated next rollout.
 136 <stub> I'm aware of one outstanding DB patch that still needs to be dealt with - ProductRelease -> Milestone linkage. I think there is an agreement already so it is just a case of landing the patch tomorrow with the others unless further issues get raised overnight.
 137 <stub> oot
 138 <matsubara> thanks stub 
 139 <matsubara> I'd like to make a quick request for you all
 140 <matsubara> if you have open items on https://edge.launchpad.net/launchpad-project/+milestone/2.1.10 please close them (mark as fix released/ implemeented or move to another milestone) 
 141 <matsubara> I need to close the 2.1.10 milestone
 142 <matsubara> anyone has anything else before I close the meeting?
 143 <flacoste> sinzui: do you have any comments for stub on the ProductRelease -> Milestone linkage?
 144 <stub> Its in email
 145 <flacoste> ok
 146 <matsubara> all right. I think that's all then.
 147 <matsubara> Thank you all for attending this week's Launchpad Production Meeting. See the channel topic for the location of the logs. 
 148 <matsubara> #endmeeting