1 <Ursinha> #startmeeting
2 <Ursinha> Welcome to this week's Launchpad Production Meeting. For the next 45 minutes or so, we'll be coordinating the resolution of specific Launchpad bugs and issues.
3 <MootBot> Meeting started at 11:01. The chair is Ursinha.
4 <MootBot> Commands Available: [TOPIC], [IDEA], [ACTION], [AGREED], [LINK], [VOTE]
5 <Ursinha> [TOPIC] Roll Call
6 <Ursinha> Not on the Launchpad Dev team? Welcome! Come "me" with the rest of us!
7 <Ursinha> me
8 <MootBot> New Topic: Roll Call
9 <gary_poster> me
10 <sinzui> me
11 <allenap> me
12 <rockstar> me
13 <chex> me
14 <Ursinha> awesome
15 * salgado has quit (Quit: rebooting, brb)
16 <Ursinha> bigjools is missing
17 * matsubara (~matsubara@canonical/launchpad/matsubara) has joined #launchpad-meeting
18 <Ursinha> matsubara, hello buddy
19 <Ursinha> I asked al-maisan if he can join us in behalf of soyuz
20 <Ursinha> moving on
21 <Ursinha> [TOPIC] Agenda
22 <Ursinha> * Actions from last meeting
23 <Ursinha> * Oops report & Critical Bugs & Broken scripts
24 <Ursinha> * Operations report (mthaddon/Chex/spm/mbarnett)
25 <Ursinha> * DBA report (stub)
26 <Ursinha> * QA stats of the week
27 <Ursinha> * Proposed items
28 <MootBot> New Topic: Agenda
29 <Ursinha> [TOPIC] * Actions from last meeting
30 <Ursinha> * Ursinha to send email to TLs about QA summaries
31 <Ursinha> * I haven't, I suck. Will do that before my EOD
32 <Ursinha> * matsubara to triage open oops-tools bugs
33 <Ursinha> * sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script
34 <Ursinha> * allenap to discuss with deryck about OOPS-1544A949 and file a bug for OOPS-1545E465.
35 <Ursinha> * OOPS-1544A949 is really bug 433995 <https://launchpad.net/bugs/433995>.
36 <Ursinha> * Bug 547063 <https://launchpad.net/bugs/547063> has been filed for OOPS-1545E465.
37 <Ursinha> * matsubara to fix linked bug for OOPS-1545E465
38 <Ursinha> * done.
39 <Ursinha> * gary_poster to discuss OOPS-1541O1653 with salgado and file a bug for it.
40 <Ursinha> * https://bugs.edge.launchpad.net/launchpad-foundations/+bug/547054
41 <Ursinha> * matsubara to email stub asking the dba report
42 <Ursinha> * done.
43 <MootBot> New Topic: * Actions from last meeting
44 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1544A949
45 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1545E465
46 <ubottu> Ubuntu bug 433995 in malone "Cannot edit importance, status or assignee after changing project inline" [High,Triaged]
47 <ubottu> Launchpad bug 433995 in malone "Cannot edit importance, status or assignee after changing project inline" [High,Triaged] https://launchpad.net/bugs/433995
48 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1544A949
49 <ubottu> Ubuntu bug 547063 in malone "None isn't acceptable as a value for BugActivity.person" [High,In progress]
50 <ubottu> Launchpad bug 547063 in malone "None isn't acceptable as a value for BugActivity.person" [High,In progress] https://launchpad.net/bugs/547063
51 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1545E465
52 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1545E465
53 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=1541O1653
54 <ubottu> Ubuntu bug 547054 in launchpad-foundations "AssertionError: Don't try to render this page when the user is logged in." [High,Fix committed]
55 * salgado (~salgado@canonical/launchpad/salgado) has joined #launchpad-meeting
56 <Ursinha> matsubara, what about yours?
57 <matsubara> not done the triage, please re-add
58 <Ursinha> yes sir
59 <matsubara> I think I fixed the linke bug for that oops
60 * salgado is now known as salgado-lunch
61 <Ursinha> [action] matsubara to triage open oops-tools bugs
62 <MootBot> ACTION received: matsubara to triage open oops-tools bugs
63 <Ursinha> matsubara, it's marked "done", so I guess you did
64 <danilos> me
65 <danilos> :)
66 <Ursinha> sinzui, what about yours?
67 <Ursinha> danilos, you're late boss
68 <Ursinha> :P
69 * danilos is sorry, lucid is all over him now
70 <Ursinha> excuses, excuses...
71 <sinzui> Ursinha, I have not done that
72 <Ursinha> sinzui, do you intend to?
73 * DavidLevin has quit (Ping timeout: 264 seconds)
74 <sinzui> yes. I think it is not as important as the real oopses and blockages that my team have
75 <Ursinha> [action] sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script
76 <MootBot> ACTION received: sinzui to follow up in work with losas to set the increase threshold for the product release finder monitoring script
77 <sinzui> wrong action
78 <sinzui> Ursinha, the losas will not make changes to the scripts. they invited me to submit a patch
79 <Ursinha> sinzui, ah, ok
80 <Ursinha> sinzui, so it's up to you to send a patch and fix that
81 <Ursinha> ?
82 <sinzui> correct
83 <Ursinha> [action] cancel last item
84 <MootBot> ACTION received: cancel last item
85 <Ursinha> sinzui, is there a bug for that?
86 <Ursinha> I can file one and then remove the action item
87 <Ursinha> we can follow up in the bug then
88 <sinzui> not that I am aware of. I do not even know which project minds that code
89 <Ursinha> sinzui, I'll go figure that out
90 * sinzui has a team and QA crisis last week and this week
91 <Ursinha> [action] Ursinha to file a bug about setting the increase threshold for the product release finder monitoring script
92 <MootBot> ACTION received: Ursinha to file a bug about setting the increase threshold for the product release finder monitoring script
93 <Ursinha> sinzui, QA crisis?
94 <Ursinha> we can discuss that during the qa stats section...
95 <Ursinha> [TOPIC] * Oops report & Critical Bugs & Broken scripts
96 <Ursinha> oops section is all foundations today: four bugs
97 <MootBot> New Topic: * Oops report & Critical Bugs & Broken scripts
98 <sinzui> the suggest packages feature on the product page was bad. I did not want users to see an incomplete feature
99 <sinzui> We could not fix the feature because we were blocked on another feature.
100 <Ursinha> sinzui, ah, I recall the discussion
101 <Ursinha> gary_poster: I filed bug 553361 re. the referrer oops. is it hard to fix?
102 <Ursinha> gary_poster: also filed bug 553368 re. the DiscoveryFailures
103 <Ursinha> gary_poster: and bug 474774 is responsible for about 30 oopses a day, any chances of being fixed soon? :)
104 <Ursinha> gary_poster: is bug 547054 really fixed? I still see a few oopses in lpnet
105 <ubottu> Launchpad bug 553361 in launchpad-foundations "OOPS when accessing launchpad with no referrer, eg. via wget" [High,Triaged] https://launchpad.net/bugs/553361
106 <ubottu> Launchpad bug 553368 in launchpad-foundations "Better handling of errors when trying to login when the op is down" [Undecided,New] https://launchpad.net/bugs/553368
107 <ubottu> Launchpad bug 474774 in launchpad-foundations "Non-ascii in the URL causes an OOPS" [High,Triaged] https://launchpad.net/bugs/474774
108 <ubottu> Launchpad bug 547054 in launchpad-foundations "AssertionError: Don't try to render this page when the user is logged in." [High,Fix committed] https://launchpad.net/bugs/547054
109 <gary_poster> 553361: we'll get that this cycle. I'm not sure what the right solution is, but whatever it is, it shud be easy.
110 <gary_poster> it is scheduled for this cycle
111 <Ursinha> gary_poster, great
112 <gary_poster> 553368: will probably triage low
113 <Ursinha> 553361 has about 1k oopses in lpnet partial summaries :/
114 <gary_poster> 474774: noure we'll have time this cycle, but maybe.
115 <gary_poster> not sure
116 <gary_poster> 547054: if we are still getting OOPSes, then I suppose it is not fixed. The remaining situations should be fairly low priority, but I'll ask salgado about them.
117 <Ursinha> thanks gary_poster
118 <gary_poster> thank you
119 <Ursinha> we have one bugs' oops, that allenap already found the bug and triaged as high: bug 365092
120 <ubottu> Launchpad bug 365092 in malone "Some bugs have BugMessage records with no corresponding MessageChunk records" [High,Triaged] https://launchpad.net/bugs/365092
121 <Ursinha> oops-prune, expire-ppa-files and calculate-bug-heat have been failing
122 <Ursinha> the last one, according to spm, was running while the check ran, should we change something to fix that?
123 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
124 <Ursinha> the failing scripts, that is
125 <allenap> Ursinha: It's named calculate_bug_heat (note the underscores) in the script. Could that cause this?
126 <allenap> chex: ^
127 <Ursinha> allenap, that's just my typo, sorry
128 <chex> allenap: ok, looking at it
129 <allenap> As in, does this check refer to ScriptActivity, or is it an OS thing.
130 <Ursinha> who should take care of the running scripts, losas or foundations?
131 <allenap> Ursinha: I can talk to chex about this outside of the meeting.
132 <Ursinha> thanks allenap :)
133 <chex> allenap: sorry, I need more context here, not quite following, my apologies
134 <Ursinha> [action] allenap to talk to chex after the meeting about the calculate_bug_heat failing script
135 <MootBot> ACTION received: allenap to talk to chex after the meeting about the calculate_bug_heat failing script
136 <Ursinha> about the other two
137 <Ursinha> [action] Ursinha to investigate about oops-prune and expire-ppa-files failing scripts
138 <MootBot> ACTION received: Ursinha to investigate about oops-prune and expire-ppa-files failing scripts
139 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
140 <Ursinha> moving on
141 <ubottu> https://lp-oops.canonical.com/oops.py/?oopsid=prune
142 <Ursinha> we have three critical bugs, all fix committed
143 <Ursinha> I suppose they were rolled out yesterday
144 <Ursinha> moving on
145 <Ursinha> [TOPIC] * Operations report (mthaddon/Chex/spm/mbarnett)
146 <MootBot> New Topic: * Operations report (mthaddon/Chex/spm/mbarnett)
147 <Ursinha> or chex :P
148 * Ursinha pokes ChanServ
149 <Ursinha> errr
150 * Ursinha pokes chex
151 <chex> wow
152 <chex> sorry folks.. here is the LOSA report for this week
153 <chex> - Launchpad Full Production V10.03 was rolled-out on Wednesday morning, some replication issues
154 <chex> caused the roll-out to take a hour longer than expected.
155 <chex> Some notes:
156 <chex> : The SSO DB Migration project is now complete, SSO is now using its own master DB.
157 <chex> : A Handful of scripts needed to be modified to work after the rollout,
158 <chex> mostly due to master/slave Postgres access changes, and have been fixed.
159 <chex> : There will be readonly downtime tomorrow at 09:00 UTC while we switch the authDB master
160 <chex> for LP which will complete the "SplitIt" project.
161 <matsubara> Ursinha, keep poking ChanServ and it'll kick ban you hehe
162 <chex> - ImportD large imports still causing problems:
163 <chex> : Pear had to be restarted last Thur 25-Apr after a large git import,
164 <chex> Bug# 536486 is still relevant.
165 <chex> and thats all for this week, any comments/questions?
166 <Ursinha> bug 536486
167 <ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
168 <gary_poster> (yay about SplitIt!)
169 <Ursinha> chex, mwhudson was working on bug 536486, it seems, but has no assignee now
170 <ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
171 <Ursinha> rockstar, do you know something about that?
172 <rockstar> Ursinha, well, it's a bug in bzr-git and jelmer is investigating it.
173 <rockstar> The Kernel import has the same issue.
174 <Ursinha> rockstar, bzr-git? so not launchpad actually?
175 <rockstar> Ursinha, yes, at least that's what we believe.
176 <rockstar> But what "launchpad" means is a bit fuzzy. It's the import worker that has the issue.
177 <Ursinha> rockstar, right.. can you explain that in the bug, please?
178 <Ursinha> maybe add another bugtask to bzr-git
179 <rockstar> Ursinha, I'm sure I can have someone else do it.
180 <Ursinha> rockstar, thank you very much
181 <chex> Ursinha: thank you guys, this is a serious problem we need to address somehow..
182 <Ursinha> [action] rockstar to find someone to look at bug 536486 and update it
183 <MootBot> ACTION received: rockstar to find someone to look at bug 536486 and update it
184 <ubottu> Launchpad bug 536486 in launchpad-code "Svn import of ruby taking 2.7G RSS" [High,Triaged] https://launchpad.net/bugs/536486
185 <chex> rockstar: you as well, sorry. :)
186 <Ursinha> anyone else?
187 <Ursinha> [TOPIC] * DBA report (stub)
188 <Ursinha> stub is excused due to our "late" meeting, he already sent the report to the list
189 <MootBot> New Topic: * DBA report (stub)
190 <Ursinha> [TOPIC] * QA stats of the week
191 <MootBot> New Topic: * QA stats of the week
192 <Ursinha> our list of untriaged bugs of this week:
193 <Ursinha> Soyuz (soyuz): 27
194 <Ursinha> launchpadlib (launchpadlib): 25
195 <Ursinha> OOPS Tools (oops-tools): 16
196 <Ursinha> Launchpad Developer Utilities (lp-dev-utils): 9
197 <Ursinha> Launchpad Auto Build System (launchpad-buildd): 6
198 <Ursinha> Launchpad Development Wiki Moin theme (launchpad-dev-moin-theme): 5
199 <Ursinha> Launchpad Bazaar Integration (launchpad-code): 5
200 <Ursinha> Launchpad Bugs (malone): 5
201 <Ursinha> Launchpad Foundations (launchpad-foundations): 4
202 <Ursinha> Launchpad Translations (rosetta): 3
203 <Ursinha> Launchpad Buildbot Configuration (lpbuildbot): 2
204 <Ursinha> trac-launchpad-migrator (trac-launchpad-migrator): 2
205 <Ursinha> launchpad-loggerhead (launchpad-loggerhead): 2
206 <Ursinha> Launchpad News WordPress Theme (launchpad-news-wordpress-theme): 2
207 <Ursinha> Launchpad QA Utilities (lp-qa-tools): 2
208 <Ursinha> Launchpad Help Wiki Moin theme (launchpad-help-moin-theme): 2
209 <Ursinha> Launchpad CSCVS (launchpad-cscvs): 2
210 <Ursinha> Launchpad itself (launchpad): 1
211 <Ursinha> Launchpad Documentation (launchpad-documentation): 1
212 <Ursinha> Tickcount (tickcount): 1
213 <Ursinha> I see soyuz is looking much better now!
214 <Ursinha> rockstar, you have bugs this week :)
215 <rockstar> Ursinha, only one, and I have no idea how to just dismiss the bug like I want to.
216 <Ursinha> about the other projects, it would be nice to triage the bugs
217 * EdwinGrubbs (~egrubbs@70-239-164-128.lightspeed.snantx.sbcglobal.net) has joined #launchpad-meeting
218 * EdwinGrubbs has quit (Changing host)
219 * EdwinGrubbs (~egrubbs@canonical/launchpad/edwingrubbs) has joined #launchpad-meeting
220 <rockstar> It looks like everyone is doing well triaging.
221 <Ursinha> rockstar, yes, indeed
222 <Ursinha> I'm talking about the smaller projects
223 <Ursinha> like loggerhead, lp-buildd
224 <Ursinha> well, I'll poke people after the meeting about them :)
225 <gary_poster> consider launchpadlib poked
226 <Ursinha> [action] Ursinha to talk to people about the untriaged bugs of smaller projects
227 <MootBot> ACTION received: Ursinha to talk to people about the untriaged bugs of smaller projects
228 <rockstar> Is loggerhead really the sole responsibility of Launchpad? I thought it was generally a community project that we happened to be eating.
229 <Ursinha> gary_poster, thanks :)
230 <Ursinha> rockstar, that's a good question; those projects are the ones under the lp-project group
231 <Ursinha> rockstar, and that's exactly what I'd like to figure out, which ones we have to keep track of
232 <rockstar> Well, technically Tarmac should also be there (I think it's currently in the bazaar group, which is wrong)
233 <gary_poster> Ursinha: to really make me weep, you can include lazr.restfulclient, lazr.restful and wadllib in the list... :-) ...and probably other lazr.* packages
234 <rockstar> Ursinha, also, I think we want to disavow all knowledge of CSCVS one day.
235 <Ursinha> gary_poster, those ones aren't included in lp project, right?
236 <gary_poster> Ursinha: right. You might be able to just point it to lazr project
237 * danilos has quit (Quit: Ex-Chat)
238 <gary_poster> Though that be a bad idea
239 <gary_poster> since it includes stuff like Storm
240 <Ursinha> [action] Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
241 <MootBot> ACTION received: Ursinha to send one email to lp list about the untriaged bugs in lp-project and others
242 <Ursinha> gary_poster, I'll send one email to lp list then we can discuss it better
243 <gary_poster> cool, Ursinha
244 <Ursinha> [TOPIC] * Proposed items
245 <Ursinha> Anyone?
246 <MootBot> New Topic: * Proposed items
247 <Ursinha> I'll consider that a no :)
248 <Ursinha> well
249 <Ursinha> Thank you all for attending this week's Launchpad Production Meeting. See https://dev.launchpad.net/MeetingAgenda for the logs.
250 <Ursinha> happy Easter for those who have it :)
251 <Ursinha> #endmeeting