1 <Ursinha> #startmeeting
   2 <Ursinha> Welcome to this week's Launchpad Production Meeting.  For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues. 
   3 <MootBot> Meeting started at 09:01. The chair is Ursinha.
   4 <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
   5 * flacoste (n=francis@canonical/launchpad/flacoste) has joined #launchpad-meeting
   6 <Ursinha> weeee I love MootBot 
   7 <Ursinha> me!
   8 <sinzui> me
   9 <al-maisan> me
  10 <flacoste> me
  11 <intellectronica> me
  12 <herb> me
  13 <Ursinha> rockstar, ping
  14 <rockstar> me
  15 <Ursinha> henninge is not here
  16 * henninge (n=henning@i577A9673.versanet.de) has joined #launchpad-meeting
  17 <henninge> me
  18 <Ursinha> :)
  19 <Ursinha> cool, everyone is here
  20 <Ursinha> apologies from matsubara and bigjools, both on leave 
  21 <Ursinha> [TOPIC] Agenda
  22 <Ursinha>  * Next meeting
  23 <Ursinha>  * Actions from last meeting
  24 <Ursinha>  * Oops report & Critical Bugs-
  25 <Ursinha>  * Operations report (mthaddon/herb/spm)
  26 <Ursinha>  * DBA report (stub)
  27 <MootBot> New Topic:  Agenda
  28 <Ursinha> right
  29 <Ursinha> [TOPIC] * Next meeting
  30 <Ursinha> it will be xmas day :) so, no meeting
  31 <Ursinha> the thursday after will new year's day, so next meeting will be on Jan 8th, is that okay for you guys? 
  32 <MootBot> New Topic:  * Next meeting
  33 <flacoste> stub is offline doing an internet upgrade
  34 <rockstar> That's more than okay with me.
  35 <Ursinha> flacoste, I saw jtv's mail, thanks!
  36 <Ursinha> awesome
  37 <Ursinha> jan 8th will be
  38 <henninge> I'll be here ... ;)
  39 <Ursinha> [TOPIC] * Actions from last meeting
  40 <Ursinha> None!
  41 <MootBot> New Topic:  * Actions from last meeting
  42 <Ursinha> cool
  43 <rockstar> Ursinha, I was just going to ditch the next two meetings.  :)
  44 <henninge> Wow!
  45 <Ursinha> henninge, what? 
  46 <Ursinha> today it'll be fast!
  47 <Ursinha> [TOPIC] * Oops report & Critical Bugs-
  48 <Ursinha> two oopses and two bugs
  49 <MootBot> New Topic:  * Oops report & Critical Bugs-
  50 <Ursinha> the oopses: timeout on +newaccount (OOPS-1083H1147), and ubuntu/+builds (OOPS-1083D1281), but I couldn't access them in time, they were giving me the permission denied message
  51 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083H1147
  52 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083D1281
  53 <Ursinha> al-maisan, can you take a look at the ubuntu/+builds one? I don't know if it's alright, but I don't recall seeing those before
  54 <al-maisan> Ursinha: will do.
  55 <Ursinha> and the newaccount one I guess it's registry
  56 <Ursinha> al-maisan, thank you!
  57 <Ursinha> [ACTION] al-maisan to take a look at OOPS-1083D1281
  58 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083D1281
  59 <MootBot> ACTION received:  al-maisan to take a look at OOPS-1083D1281
  60 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083D1281
  61 <Ursinha> sinzui, hi
  62 <Ursinha> sinzui, can you or someone look at that timeout oops, please?
  63 <Ursinha> erm
  64 <Ursinha> let's move to the bugs
  65 <Ursinha> two bugs for bugs team, api related
  66 <Ursinha> bug 308982, bug 296293 
  67 <ubottu> Launchpad bug 308982 in malone "ForbiddenAttribute error when setting private field over webservice" [High,Triaged] https://launchpad.net/bugs/308982
  68 <ubottu> Launchpad bug 296293 in malone "Trying to search through the API for bugtasks passing milestone="url" gives a 500, Internal Server Error" [Undecided,New] https://launchpad.net/bugs/296293
  69 <Ursinha> intellectronica, hi :)
  70 <intellectronica> Ursinha: i'm dealing with both
  71 <Ursinha> intellectronica, awesome! can you set the attributes on the second one, please?
  72 <Ursinha> I'd love to have that fixed
  73 <sinzui> Ursinha: I can, but I think the problems are in the syouz domain
  74 <intellectronica> sure, doing that now
  75 <Ursinha> sinzui, the +newaccount one?
  76 * Ursinha looks again
  77 * sinzui opened the second oops twice. oops
  78 <al-maisan> sinzui: how so?
  79 <al-maisan> ah
  80 <Ursinha> oh :)
  81 <henninge> ee?
  82 <rockstar> oi
  83 <Ursinha> lol
  84 <Ursinha> sinzui, so, what do you think?
  85 <sinzui> Ursinha: This may be a duplicate. bac is has a fix for some readonly items in review now
  86 <Ursinha> sinzui, right, I'll talk to him about it
  87 <Ursinha> didn't have the time to investigate, oops was unavailable
  88 <Ursinha> [ACTION] Ursinha to talk to bac about OOPS-1083H1147
  89 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083H1147
  90 <MootBot> ACTION received:  Ursinha to talk to bac about OOPS-1083H1147
  91 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083H1147
  92 <Ursinha> right
  93 <bac> sinzui: i did not address those bugs as it looked like intellectronica was on it.  i can include in my branch if we want
  94 <sinzui> The specific issue in the oops is that the bugs API is not properly documented
  95 <Ursinha> sinzui, oh, you're talking about bugs' bugs
  96 <intellectronica> well, it's not really a documentation problem. when the annotations are fixed the documentation should pick it up just fine
  97 <sinzui> bug 308982 indicates that the bug API exported some of the attributes as mutable, and they are not
  98 <ubottu> Launchpad bug 308982 in malone "ForbiddenAttribute error when setting private field over webservice" [High,Triaged] https://launchpad.net/bugs/308982
  99 <intellectronica> exactly
 100 <Ursinha> well, are you going to keep them intellectronica?
 101 <intellectronica> keep them exported, but correct the annotation, yes
 102 <Ursinha> okay
 103 * sinzui now sees the real oops
 104 <Ursinha> can you comment on the bug properly? guess you're already doing that, but anyway :)
 105 <Ursinha> intellectronica, ^
 106 <intellectronica> doing that
 107 <Ursinha> intellectronica, thanks
 108 <Ursinha> sinzui, and the oops...
 109 <sinzui> Ursinha: I investigated the logintokens this morning. They work (by work, I stole someone's account--they really work)
 110 <sinzui> Ursinha: There was definitely something wrong in the DB yesterday that caused this.
 111 <sinzui> Ursinha: replication perhaps
 112 <Ursinha> sinzui, right. I'll watch it for the next hours/days
 113 <Ursinha> will bring the issue to attention if occurs again
 114 <Ursinha> [ACTION] Ursinha to watch for new occurrences of OOPS-1083H1147 the next hours/days
 115 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083H1147
 116 <MootBot> ACTION received:  Ursinha to watch for new occurrences of OOPS-1083H1147 the next hours/days
 117 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1083H1147
 118 <Ursinha> thanks sinzui 
 119 <Ursinha> we have three critical bugs
 120 <Ursinha> all fix committed
 121 <Ursinha> one is that launchpad-bugzilla one that was always there
 122 <Ursinha> one is soyuz and another coswe
 123 <Ursinha> argh
 124 <Ursinha> *code
 125 <al-maisan> aha :)
 126 <Ursinha> rockstar, can you set the right status, please please please? :)
 127 <Ursinha> rockstar, good morning, btw :P
 128 <rockstar> Do we need to close out 2.1.12?
 129 <Ursinha> rockstar, we'll need to close it, yeah
 130 <rockstar> I think I'll probably just do the two birds/one stone thing then.
 131 <Ursinha> two birds? lol
 132 <Ursinha> rockstar, thanks :)
 133 <henninge> "Close out" is setting all the statusses on bugs and blueprints to Released, right?
 134 <Ursinha> rockstar, but setting the status of the critical to fix release is fine for now
 135 <Ursinha> henninge, right :)
 136 <Ursinha> all of you, please, having pending items to close, let's do it!
 137 <henninge> Pleeease do that.
 138 <Ursinha> or close or redirect to 2.2.1
 139 <Ursinha> henninge, what do you mean?
 140 <henninge> Mat includes a link to the milestone page in the release announcement and I find the current state of that page less than fitting to be released publicly.
 141 <al-maisan> we did that for the Soyuz 2.1.12 milestone today
 142 <al-maisan> i.e. close it out.
 143 <Ursinha> al-maisan, great, thanks a lot
 144 <Ursinha> henninge, hmm
 145 <Ursinha> mrevell, hi :)
 146 <mrevell> hey there Ursinha
 147 <Ursinha> want to be the special guest ?
 148 <Ursinha> :)
 149 <Ursinha> see what henninge said above, please
 150 <mrevell> Sorry, I haven't been following the meeting, I'm about to go on a call.
 151 * mrevell looks
 152 <Ursinha> mrevell, no problem, you don't have to
 153 <Ursinha> join the meeting, that is
 154 * e-jat (n=fenris@ubuntu/member/fenris-) has joined #launchpad-meeting
 155 * henninge used "Mat" on purpose ... ;)
 156 <mrevell> :) Yes, I do see what henninge says and I agree but I think we should fix it by updating statuses
 157 <mrevell> not by removing the link from the release notes :)
 158 <henninge> that is what I mean!
 159 <henninge> :-)
 160 <Ursinha> :)
 161 <Ursinha> right, so let's all do the effort to close the items out
 162 <Ursinha> right all?
 163 <Ursinha> soyuz already done
 164 <rockstar> Yes, but often, many of us are not awake when they go from committed to released.
 165 <Ursinha> rockstar, I know that
 166 <Ursinha> but they'll be online later, right? :)
 167 <Ursinha> they always come back
 168 <Ursinha> let's try to close it all for the end of Friday
 169 <Ursinha> I think it's a good day
 170 <Ursinha> everyone ok with that?
 171 <Ursinha> hope so
 172 <Ursinha> let's move on
 173 <Ursinha> thanks mrevell 
 174 <Ursinha> and everyone else :)
 175 <Ursinha> [TOPIC] * Operations report (mthaddon/herb/spm)
 176 <MootBot> New Topic:  * Operations report (mthaddon/herb/spm)
 177 <herb> * Yesterday (2008-12-17) - Rolled out r7469 as 2.1.12
 178 <Ursinha> hi herb
 179 <herb> * Bugs #156453 and #118625 continue to be a problem, resulting in restarts of codebrowse multiple times this week.
 180 <herb> * Bug #260171 continues to be a problem as well
 181 <herb> hi
 182 <herb> * Bug #252807 has cropped up a couple of times this week.
 183 <ubottu> Launchpad bug 156453 in loggerhead "production loggerhead branch leaks memory" [Critical,In progress] https://launchpad.net/bugs/156453
 184 <ubottu> Launchpad bug 118625 in launchpad-bazaar "codebrowse sometimes hangs" [High,Triaged] https://launchpad.net/bugs/118625
 185 <herb> * Bugs #49676 & #45419 are becoming more and more important as we spend more and more time dealing with spam on launchpad, a process which is far too manual.
 186 <ubottu> Bug 260171 on http://launchpad.net/bugs/260171 is private
 187 <ubottu> Bug 252807 on http://launchpad.net/bugs/252807 is private
 188 <ubottu> Bug 49676 on http://launchpad.net/bugs/49676 is private
 189 <Ursinha> holy cow
 190 <Ursinha> rockstar, the loggerhead one you can comment, I guess
 191 <Ursinha> also the codebrowse hanging other
 192 <rockstar> I can, but I only saw the cherrypick, don't know the context.  I know we've been trying.
 193 <rockstar> Python sucks.
 194 <Ursinha> don't say that
 195 <rockstar> :)
 196 <Ursinha> :)
 197 <Ursinha> rockstar, what can you do about it?
 198 <Ursinha> talk with beuno?
 199 <sinzui> loggerhead's app and infrastructure sucks
 200 <rockstar> We're working hard to try and get those leaks down, but right now, it's black magic.
 201 <rockstar> sinzui, it's gotten a lot better, but the memory usage hasn't gone down...  :/
 202 <Ursinha> rockstar, well... the same thing as every week... comment on the bug and stuff
 203 <rockstar> I could expand that to "Python's tool support sucks"
 204 <Ursinha> even if the comment is "man, no idea wha't happening"
 205 <al-maisan> this is a really cheerful meeting :)
 206 <al-maisan> all technology sucks BTW :)
 207 <Ursinha> al-maisan, you should come over every weelk :)
 208 <rockstar> Well, I can do that once a week if you like.  I'll probably just use the API and a cron job.
 209 <Ursinha> al-maisan, :)
 210 <al-maisan> sure ;)
 211 <herb> rockstar: I think we can tolerate the memory usage being in the 1.5-2GB range if the app didn't go on walk about from time to time.  1.5-2GB and responding quickly is fine.  1.5-2GB and taking 10+ seconds to respond, no so much.
 212 <rockstar> herb: I'm 95% sure that the two are closely related.
 213 <herb> rockstar: I suspect so.
 214 <herb> rockstar: but I didn't want to focus on the memory issue and lose the performance problem in the process.
 215 <rockstar> Well, I'm pretty free for the next two weeks, so I'll probably check it out at some point.
 216 <Ursinha> rockstar, great
 217 <Ursinha> please
 218 <Ursinha> I pay you a coke on allhands
 219 <rockstar> :)
 220 <Ursinha> :)
 221 <Ursinha> right, the other problems
 222 <Ursinha> bug 260171 is also code
 223 <ubottu> Bug 260171 on http://launchpad.net/bugs/260171 is private
 224 <Ursinha> bug 49676, sinzui, is this registry?
 225 <ubottu> Bug 49676 on http://launchpad.net/bugs/49676 is private
 226 <Ursinha> damn private bugs..
 227 <sinzui> Ursinha: yes
 228 <Ursinha> sinzui, well, is something to be done about that?
 229 <rockstar> I know nothing about 260171 -- I'll have to wait for AsiaPac to wake up.
 230 <Ursinha> rockstar, I see that are other code bugs 
 231 <Ursinha> or you or me can talk to them later
 232 <rockstar> Ursinha, yea, I'll bug 'em.  I need to bug mwh anyway.
 233 <sinzui> i am still planning a follow to my CHR email, the one where I ask how many man hours are we wasting doing manual labour when we could have built tools to do it for us
 234 <rockstar> But we're almost all on leave for the next two weeks.
 235 <sinzui> I don't want to commit to when these items will be fix until I really know their priority.
 236 <Ursinha> [ACTION] Ursinha and rockstar to talk to code people about 260171 and 252807
 237 <MootBot> ACTION received:  Ursinha and rockstar to talk to code people about 260171 and 252807
 238 <Ursinha> sinzui, fair enough.
 239 <Ursinha> [ACTION] sinzui to find out the priority of automatizing manual processes such as bug 49676
 240 <MootBot> ACTION received:  sinzui to find out the priority of automatizing manual processes such as bug 49676
 241 <ubottu> Bug 49676 on http://launchpad.net/bugs/49676 is private
 242 <Ursinha> is that ok?
 243 <ubottu> Bug 49676 on http://launchpad.net/bugs/49676 is private
 244 <rockstar> Ursinha, 252807 is being solved bf abentley's work.  It'll probably be in 2.2.1
 245 <rockstar> s/bf/by
 246 <Ursinha> rockstar, right
 247 <Ursinha> rockstar, can you ask him to do a follow-up in the bug
 248 <Ursinha> please?
 249 <Ursinha> and assign it to 2.2.1 milestone, if appropriated
 250 <rockstar> Ursinha, he's on leave 'til next year.
 251 <Ursinha> rockstar, well, I can do that so
 252 <rockstar> I don't know the details of his work though, so I can't make a solid commitment on when it'll land though.
 253 <Ursinha> [ACTION] talk to abentley about the status of bug 252807
 254 <MootBot> ACTION received:  talk to abentley about the status of bug 252807
 255 <ubottu> Bug 252807 on http://launchpad.net/bugs/252807 is private
 256 <ubottu> Bug 252807 on http://launchpad.net/bugs/252807 is private
 257 <Ursinha> that's okay
 258 <Ursinha> anything else for herb?
 259 <Ursinha> moving on
 260 <Ursinha> [TOPIC] * DBA report (stub)
 261 <Ursinha> as jvt mail said, also flacoste, stub is offline, so isn't here
 262 <Ursinha> everything went fine in the rollout 
 263 <MootBot> New Topic:  * DBA report (stub)
 264 <Ursinha> anything for stub?
 265 <Ursinha> I'll mail him later, if needed
 266 <Ursinha> if not, and everyone's okay with that, and have nothing to say, I'll declare finished our last production meeting of 2008
 267 <flacoste> objectivion!
 268 <flacoste> i have something
 269 <Ursinha> you always do :)
 270 <Ursinha> go ahead
 271 <flacoste> :-)
 272 <flacoste> there has been one r-c branched landed after the roll-out
 273 <flacoste> cprov's branch
 274 <flacoste> is there any other r-c issues today
 275 <flacoste> ?
 276 <Ursinha> flacoste, not that I'm aware of
 277 <flacoste> anything that we need to fix and make as part of a follow-up roll-out?
 278 <rockstar> Not from code
 279 <Ursinha> no weird oopses
 280 <Ursinha> no strange bugs, afai checked
 281 <flacoste> i've seen one, but i'm not sure yet if we should worry about it
 282 * fenris_ (n=fenris@248.97.48.60.wmu01-home.tm.net.my) has joined #launchpad-meeting
 283 <Ursinha> flacoste, oops?
 284 <Ursinha> or bug?
 285 <Ursinha> or what
 286 <flacoste> yeah OOPS-1082A2155
 287 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1082A2155
 288 * e-jat has quit (Read error: 60 (Operation timed out))
 289 <flacoste> 14 of those
 290 <Ursinha> this one I was investigating before the meeting
 291 <Ursinha> but couldn't do it on time
 292 <Ursinha> flacoste, are you doing the same?
 293 <flacoste> Ursinha: yes, i'll have a look at it
 294 <Ursinha> thanks flacoste 
 295 <flacoste> sinzui, cprov, henninge: anything else?
 296 * fenris_ is now known as e-jat
 297 <Ursinha> [ACTION] flacoste to look at OOPS-1082A2155
 298 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1082A2155
 299 <MootBot> ACTION received:  flacoste to look at OOPS-1082A2155
 300 <ubottu> https://devpad.canonical.com/~jamesh/oops.cgi/1082A2155
 301 <henninge> nope
 302 <flacoste> cprov: does you r-c landing warrants a re-roll?
 303 <Ursinha> flacoste, I'll let you know if something weird appears
 304 <al-maisan> cprov i snot here
 305 <al-maisan> is not here
 306 <Ursinha> flacoste, I guess cprov is out
 307 <Ursinha> as al-maisan said :)
 308 <al-maisan> I believe he is collecting his wife from the airport
 309 <sinzui> flacoste: nothing from me
 310 <al-maisan> I don't know of any rc's in Soyuz land
 311 <Ursinha> al-maisan, do you know if he will return?
 312 <al-maisan> Ursinha: he certaily will .. the question is when :)
 313 <Ursinha> lol
 314 <Ursinha> sorry
 315 <al-maisan> *certainly*
 316 <Ursinha> I mean today
 317 <flacoste> the landing was about:
 318 <flacoste> Clearer PPA signing key UID format
 319 <flacoste>         ('Launchpad %(ppa.title)s').
 320 <Ursinha> al-maisan, https://dev.launchpad.net/SoyuzTestPlan/2.1.12
 321 <Ursinha> the items needstesting in there
 322 <Ursinha> I guess
 323 * al-maisan takes a look
 324 <Ursinha> the one flacoste pointed
 325 <Ursinha> exactly :)
 326 <flacoste> Ursinha: ok, so i'll postpone the decision for a re-roll to the investigation of the OOPs and cprov prodiving info on the branch
 327 <Ursinha> flacoste, okay
 328 <al-maisan> re. cprov, he is also not feeling well today .. he might have to go and see a doctor
 329 <Ursinha> worth a quick call to him?
 330 <Ursinha> very quick
 331 <al-maisan> what do you mean?
 332 <Ursinha> or asking kiko maybe
 333 <al-maisan> call him on the phone?
 334 <Ursinha> al-maisan, yes, the old technology
 335 <Ursinha> :)
 336 <al-maisan> kiko is travelling
 337 <Ursinha> so we have no way out
 338 <Ursinha> flacoste, what do you suggest?
 339 <flacoste> Ursinha, al-maisan: i'll call his cell
 340 <Ursinha> flacoste, great, thanks
 341 <Ursinha> anything else?
 342 <al-maisan> why is the call necessary?
 343 <al-maisan> what is the matter of urgency?
 344 <flacoste> al-maisan: to decide if we are doing another roll-out today or not
 345 <Ursinha> to decide about the re-roll
 346 <Ursinha> yes
 347 <flacoste> al-maisan: iow, does this branch needs to be in production
 348 <al-maisan> this one: r7471 [testfix][release-critical] Fixing test failure in the previous revision. ?
 349 <flacoste> al-maisan: the previous one
 350 <Ursinha> al-maisan, no, the previous one
 351 <al-maisan> ah, I see.
 352 <flacoste> well, both of them actually
 353 <flacoste> since they go together :-)
 354 <Ursinha> :)
 355 <al-maisan> proposal: I will check later to see whether cprov is back on-line
 356 <flacoste> al-maisan: cool
 357 <al-maisan> if not, I can give him a call and ask the question
 358 <Ursinha> al-maisan, alright
 359 <Ursinha> thanks 
 360 <Ursinha> well
 361 <Ursinha> anything else?
 362 <Ursinha> soooo
 363 <Ursinha> Thank you all for attending this week's Launchpad Production Meeting, the last one of the year 2008! Happy Holidays everyone, see you all next year! See the channel topic for the location of the logs.
 364 <Ursinha> #endmeeting