⚓ T238751 Only generate maxlag from pooled query service servers.
Page Menu
Phabricator
Create Task
Maniphest
T238751
Only generate maxlag from pooled query service servers.
Closed, Resolved
Public
Actions
Edit Task
Edit Related Tasks...
Create Subtask
Edit Parent Tasks
Edit Subtasks
Merge Duplicates In
Close As Duplicate
Edit Related Objects...
Edit Commits
Edit Mocks
Mute Notifications
Protect as security issue
Assigned To
hoo
Authored By
Addshore
Nov 20 2019, 3:46 PM
2019-11-20 15:46:15 (UTC+0)
Tags
Wikidata
(in progress)
User-Addshore
(Active 🚁)
Patch-For-Review
Sustainability (Incident Followup)
[DEPRECATED] wdwb-tech
(Sorted Team A)
SRE-OnFire
(Backlog)
User-ItamarWMDE
(Doing)
wmde-wikidata-tech
(Incoming)
Wikidata-Query-Service
(Watching / Waiting)
MW-1.40-notes (1.40.0-wmf.5; 2022-10-10)
Referenced Files
None
Subscribers
Addshore
Aklapper
akosiaris
bking
Gehel
ItamarWMDE
Jheald
View All 12 Subscribers
Description
In
T221774
max lag started being counted when figuring out the max lag value.
Everything there is now deployed and working, but the median turns out to not be the best value to use for the lag.
The discovery team pointed us toward
and
which shows the pooled servers.
Using this we would be able to actually base the maxlag for the query service on the maximum lag of pooled servers.
The maintenance script could first query these 2 config locations, creating a list of instances that we actually care about.
WikimediaPrometheusQueryServiceLagProvider:: getLags could then filter out any not pooled servers.
Details
Related Changes in Gerrit:
Subject
Repo
Branch
Lines +/-
Update cron with lb and lb-pool params
operations/puppet
production
+1
-1
Only generate QS maxlag for pooled servers
mediawiki/extensions/Wikidata.org
wmf/1.40.0-wmf.6
+722
-371
Add an integration test for updateQueryServiceLag
mediawiki/extensions/Wikidata.org
master
+95
-0
Only generate QS maxlag for pooled servers
mediawiki/extensions/Wikidata.org
master
+722
-371
updateQueryServiceLag: Add lb(-pool) options for forward compatibility
mediawiki/extensions/Wikidata.org
wmf/1.40.0-wmf.5
+16
-0
updateQueryServiceLag: Add lb(-pool) options for forward compatibility
mediawiki/extensions/Wikidata.org
wmf/1.40.0-wmf.4
+16
-0
updateQueryServiceLag: Add lb(-pool) options for forward compatibility
mediawiki/extensions/Wikidata.org
master
+16
-0
Revert "maintenance::wikidata: Update cron with lb and lb-pool params"
operations/puppet
production
+3
-20
maintenance::wikidata: Update cron with lb and lb-pool params
operations/puppet
production
+20
-3
Revert "Temp remove codfw from wikidata updateQueryServiceLag check"
operations/puppet
production
+1
-2
Temp remove codfw from wikidata updateQueryServiceLag check
operations/puppet
production
+2
-1
Switch query service maxlag to be median +1
mediawiki/extensions/Wikidata.org
master
+21
-3
Switch query service maxlag to be median +1
mediawiki/extensions/Wikidata.org
wmf/1.35.0-wmf.28
+2
-2
Show related patches
Customize query in gerrit
Related Objects
Search...
Task Graph
Mentions
Status
Subtype
Assigned
Task
Resolved
Gehel
T297555
[epic] Brian's onboarding to the Search Platform team
Resolved
bking
T336134
wdqs2*** lagged for more than one day
Open
None
T270614
Automatically depool wdqs servers that are "lagged"
Resolved
hoo
T238751
Only generate maxlag from pooled query service servers.
Open
None
T239392
Applications and scripts need to be able to understand the pooled status of servers in our load balancers.
Resolved
hoo
T315423
Revive and merge patch to update maxlag calculation
Mentioned In
T322030: Revert query service maxlag criteria from “most lagged” back to median-based implementation
T322010: Depool wdqs1007
T293063: Write and adapt Runbooks and cookbooks related to the WDQS Streaming Updater and kubernetes
T315455: Investigate what caused our WDQS update lag to drop and remain below SLO on 28/07
T315423: Revive and merge patch to update maxlag calculation
T302330: Wikidata MaxLag above 10 for 1hr
T270614: Automatically depool wdqs servers that are "lagged"
T252739: Define a hard upper limit of query service based maxlag
T252091: RFC: Site-wide edit rate limiting with PoolCounter
T242453: Detect and alert and/or remediate Blazegraph deadlocks
T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)
T244722: increase factor for query service that is taken into account for maxlag
T226413: Investigate rate limiting of edits on WDQS
T238229: WDQS is having high update lag for the last week
T221774: Add Wikidata query service lag to Wikidata maxlag
Mentioned Here
T315423: Revive and merge patch to update maxlag calculation
T239392: Applications and scripts need to be able to understand the pooled status of servers in our load balancers.
T238229: WDQS is having high update lag for the last week
T221774: Add Wikidata query service lag to Wikidata maxlag
Event Timeline
There are a very large number of changes, so older changes are hidden.
Show Older Changes
Addshore
mentioned this in
T226413: Investigate rate limiting of edits on WDQS
Dec 12 2019, 1:06 PM
2019-12-12 13:06:02 (UTC+0)
Addshore
reassigned this task from
Addshore
to
Joe
Jan 7 2020, 10:55 AM
2020-01-07 10:55:13 (UTC+0)
Addshore
lowered the priority of this task from
Medium
to
Low
Addshore
added a subscriber:
Ladsgroup
Comment Actions
@Joe
If you get any chance to look at the puppet patch again that would be great!
Any comments that
@Ladsgroup
and I or others can work toward would be grand, but right now we will wait for that review
Addshore
mentioned this in
T244722: increase factor for query service that is taken into account for maxlag
Feb 17 2020, 8:08 AM
2020-02-17 08:08:58 (UTC+0)
Dvorapa
mentioned this in
T243701: Wikidata maxlag repeatedly over 5s since Jan 20, 2020 (primarily caused by the query service)
Mar 16 2020, 6:22 PM
2020-03-16 18:22:18 (UTC+0)
Addshore
mentioned this in
T242453: Detect and alert and/or remediate Blazegraph deadlocks
Apr 18 2020, 12:27 PM
2020-04-18 12:27:56 (UTC+0)
gerritbot
added a comment.
Apr 18 2020, 4:45 PM
2020-04-18 16:45:10 (UTC+0)
Comment Actions
Change 589873 had a related patch set uploaded (by Addshore; owner: Addshore):
[mediawiki/extensions/Wikidata.org@master] Switch query service maxlag to be median +1
gerritbot
added a comment.
Apr 18 2020, 4:45 PM
2020-04-18 16:45:32 (UTC+0)
Comment Actions
Change 589874 had a related patch set uploaded (by Addshore; owner: Addshore):
[mediawiki/extensions/Wikidata.org@wmf/1.35.0-wmf.28] Switch query service maxlag to be median +1
gerritbot
added a comment.
Apr 22 2020, 10:18 PM
2020-04-22 22:18:54 (UTC+0)
Comment Actions
Change 589874 abandoned by Addshore:
Switch query service maxlag to be median 1
gerritbot
added a comment.
Apr 29 2020, 8:48 PM
2020-04-29 20:48:42 (UTC+0)
Comment Actions
Change 589873
merged
by jenkins-bot:
[mediawiki/extensions/Wikidata.org@master] Switch query service maxlag to be median +1
Addshore
added a project:
Sustainability (Incident Followup)
May 12 2020, 8:34 PM
2020-05-12 20:34:11 (UTC+0)
Addshore
mentioned this in
T252091: RFC: Site-wide edit rate limiting with PoolCounter
May 28 2020, 4:52 PM
2020-05-28 16:52:18 (UTC+0)
Addshore
edited projects, added
[DEPRECATED] wdwb-tech
; removed
Wikidata-Campsite (Wikidata-Campsite-Iteration-∞ (On Hold))
Jan 25 2021, 12:27 PM
2021-01-25 12:27:17 (UTC+0)
Addshore
moved this task from
Inbox
to
Blocked
on the
[DEPRECATED] wdwb-tech
board.
Addshore
lowered the priority of this task from
Low
to
Lowest
Jun 15 2021, 3:53 PM
2021-06-15 15:53:39 (UTC+0)
Comment Actions
Lowest as this hasn't come up in quite some time, and blocked on being able to do this "properly".
Bugreporter
mentioned this in
T252739: Define a hard upper limit of query service based maxlag
Jun 21 2021, 7:44 PM
2021-06-21 19:44:04 (UTC+0)
Addshore
mentioned this in
T270614: Automatically depool wdqs servers that are "lagged"
Aug 26 2021, 1:12 PM
2021-08-26 13:12:21 (UTC+0)
Lucas_Werkmeister_WMDE
raised the priority of this task from
Lowest
to
Low
Nov 12 2021, 10:45 AM
2021-11-12 10:45:55 (UTC+0)
Lucas_Werkmeister_WMDE
subscribed.
Comment Actions
Bumping priority as it has come up again. Between 5:43 and 8:35 UTC today, wdqs1005
caught up on triples
and
lag
Wikidata maxlag exceeded 5 s
, and
bot edits stopped almost completely
, which was enough of a decrease in total edit rate that an alert started firing. (I hope that wdqs1005 was actually depooled while it was catching up, but I don’t know how to find that out for sure.)
Tarrow
mentioned this in
T302330: Wikidata MaxLag above 10 for 1hr
Feb 22 2022, 7:08 PM
2022-02-22 19:08:30 (UTC+0)
gerritbot
added a comment.
Feb 22 2022, 7:13 PM
2022-02-22 19:13:51 (UTC+0)
Comment Actions
Change 764875 had a related patch set uploaded (by Addshore; author: Addshore):
[operations/puppet@production] Temp remove codfw
gerritbot
added a comment.
Feb 22 2022, 7:23 PM
2022-02-22 19:23:55 (UTC+0)
Comment Actions
Change 764875
merged
by Ryan Kemper:
[operations/puppet@production] Temp remove codfw from wikidata updateQueryServiceLag check
gerritbot
added a comment.
Feb 23 2022, 12:16 PM
2022-02-23 12:16:21 (UTC+0)
Comment Actions
Change 764830 had a related patch set uploaded (by Addshore; author: Addshore):
[operations/puppet@production] Revert \"Temp remove codfw from wikidata updateQueryServiceLag check\"
RKemper
added a project:
SRE-OnFire
Feb 24 2022, 6:18 PM
2022-02-24 18:18:06 (UTC+0)
karapayneWMDE
subscribed.
Mar 30 2022, 2:44 PM
2022-03-30 14:44:29 (UTC+0)
Addshore
awarded a token.
Mar 30 2022, 2:57 PM
2022-03-30 14:57:46 (UTC+0)
dcausse
added a project:
Discovery-Search
Mar 30 2022, 3:06 PM
2022-03-30 15:06:19 (UTC+0)
ItamarWMDE
added a project:
User-ItamarWMDE
Mar 30 2022, 3:09 PM
2022-03-30 15:09:23 (UTC+0)
ItamarWMDE
moved this task from
Radar
to
Radar
on the
User-ItamarWMDE
board.
bking
subscribed.
Mar 30 2022, 3:47 PM
2022-03-30 15:47:16 (UTC+0)
Lydia_Pintscher
raised the priority of this task from
Low
to
High
Edited
Mar 30 2022, 4:03 PM
2022-03-30 16:03:36 (UTC+0)
Lydia_Pintscher
subscribed.
Comment Actions
Changing the priority to high based on today's discussion in the query service sync. This is becoming more important for editors because maxlag is growing when a server is depooled, causing a slowdown of edits for bots.
Lydia_Pintscher
added a parent task:
T270614: Automatically depool wdqs servers that are "lagged"
Mar 30 2022, 4:05 PM
2022-03-30 16:05:45 (UTC+0)
Lydia_Pintscher
added a subtask:
T239392: Applications and scripts need to be able to understand the pooled status of servers in our load balancers.
gerritbot
added a comment.
Apr 4 2022, 2:17 PM
2022-04-04 14:17:04 (UTC+0)
Comment Actions
Change 764830
merged
by Bking:
[operations/puppet@production] Revert "Temp remove codfw from wikidata updateQueryServiceLag check"
MPhamWMF
moved this task from
needs triage
to
Current work
on the
Discovery-Search
board.
Apr 4 2022, 3:21 PM
2022-04-04 15:21:45 (UTC+0)
MPhamWMF
edited projects, added
Discovery-Search (Current work)
; removed
Discovery-Search
MPhamWMF
moved this task from
Incoming
to
Blocked/Waiting
on the
Discovery-Search (Current work)
board.
Addshore
added a subscriber:
akosiaris
Apr 13 2022, 2:42 PM
2022-04-13 14:42:49 (UTC+0)
Comment Actions
@Joe
(Also pinging
@akosiaris
as I know joe is out right now).
It seems like the ideal solution of
T239392: Applications and scripts need to be able to understand the pooled status of servers in our load balancers.
might not happen for some time.
Would it be possible to resolve this for now with
which I believe would have been "fine" TM for the last 2.5 years and decreased humans touching things and also decreased the number of issues users end up seeing around delayed / broken but depooled wdqs hosts?
akosiaris
added a comment.
Apr 13 2022, 2:59 PM
2022-04-13 14:59:19 (UTC+0)
Comment Actions
In
T238751#7851690
@Addshore
wrote:
@Joe
(Also pinging
@akosiaris
as I know joe is out right now).
It seems like the ideal solution of
T239392: Applications and scripts need to be able to understand the pooled status of servers in our load balancers.
might not happen for some time.
Would it be possible to resolve this for now with
which I believe would have been "fine" TM for the last 2.5 years and decreased humans touching things and also decreased the number of issues users end up seeing around delayed / broken but depooled wdqs hosts?
That patch is already out of date. lvs2003 is no longer around pointing out exactly why the approach of hardcoding an LVS server in the patch would be problematic.
Ladsgroup
added a comment.
Apr 13 2022, 8:31 PM
2022-04-13 20:31:14 (UTC+0)
Comment Actions
Do we really need this now that everything is on flink and fancy?
Lydia_Pintscher
added a comment.
Apr 14 2022, 8:47 AM
2022-04-14 08:47:09 (UTC+0)
Comment Actions
Yes, we've had several occurrences over the last months where editors complained about maxlag being high and it was caused by a server being depooled. (And yes I really believe we need to keep the maxlag coupling.)
Addshore
added a comment.
Apr 14 2022, 8:58 AM
2022-04-14 08:58:37 (UTC+0)
Comment Actions
I think
@Ladsgroup
s point is rather than we potentially do not need to include wdqs delay in maxlag now, as the updater is stable and fast.
In
T238751#7854615
@Lydia_Pintscher
wrote:
Yes, we've had several occurrences over the last months where editors complained about maxlag being high and it was caused by a server being depooled. (And yes I really believe we need to keep the maxlag coupling.)
Indeed, but this was only caused by the fact that this check exists and is broken in a couple of ways.
A server being depooled right now has no / minimal user facing impact of itself, ONLY the fact that this check is broken and thus falsely creates maxlag.
gerritbot
added a comment.
May 23 2022, 8:22 AM
2022-05-23 08:22:55 (UTC+0)
Comment Actions
Change 797077 had a related patch set uploaded (by Giuseppe Lavagetto; author: Giuseppe Lavagetto):
[operations/puppet@production] maintenance::wikidata: Update cron with lb and lb-pool params
Joe
added a comment.
May 23 2022, 9:25 AM
2022-05-23 09:25:46 (UTC+0)
Comment Actions
Given the changes we've made to puppet in the meantime, I am now able to feed the right parameters to the script if we want to.
The following patch
will cause these corresponding changes in puppet:
@Addshore
does that look right to you?
The big advantage is that we won't need to change anything when a new LVS server goes into rotation, puppet will take care of update it, although there will probably be a short interval when a server is not responsive when a new one gets installed. What is the failure mode of the Wikidata code?
Addshore
added a comment.
May 31 2022, 12:29 PM
2022-05-31 12:29:52 (UTC+0)
Comment Actions
I believe that this will do the right thing!
gerritbot
added a comment.
Jun 1 2022, 8:28 AM
2022-06-01 08:28:03 (UTC+0)
Comment Actions
Change 797077
merged
by Giuseppe Lavagetto:
[operations/puppet@production] maintenance::wikidata: Update cron with lb and lb-pool params
gerritbot
added a comment.
Jun 1 2022, 8:35 AM
2022-06-01 08:35:50 (UTC+0)
Comment Actions
Change 801762 had a related patch set uploaded (by Giuseppe Lavagetto; author: Giuseppe Lavagetto):
[operations/puppet@production] Revert "maintenance::wikidata: Update cron with lb and lb-pool params"
Joe
added a comment.
Edited
Jun 1 2022, 8:36 AM
2022-06-01 08:36:49 (UTC+0)
Comment Actions
Sadly I had to revert, because the
--lb
and the
--lb-pool
commands are not recognized by the script.
mwmaint1002:~$ /usr/local/bin/mwscript extensions/Wikidata.org/maintenance/updateQueryServiceLag.php --wiki wikidatawiki --cluster wdqs --prometheus prometheus.svc.eqiad.wmnet --prometheus prometheus.svc.codfw.wmnet --lb-pool wdqs_80 --lb lvs1019:9090 --lb lvs2009:9090
Unexpected option lb-pool!
Unexpected option lb!
gerritbot
added a comment.
Jun 1 2022, 8:37 AM
2022-06-01 08:37:17 (UTC+0)
Comment Actions
Change 801762
merged
by Giuseppe Lavagetto:
[operations/puppet@production] Revert "maintenance::wikidata: Update cron with lb and lb-pool params"
Addshore
added a comment.
Jun 1 2022, 8:37 AM
2022-06-01 08:37:32 (UTC+0)
Comment Actions
*looks at the script closer*
Addshore
added a comment.
Jun 1 2022, 8:38 AM
2022-06-01 08:38:59 (UTC+0)
Comment Actions
Right,
needs to go in first!
(Sorry for missing that
@Joe
, the extended timeline messed with my head)
ItamarWMDE
subscribed.
Edited
Jun 8 2022, 12:55 PM
2022-06-08 12:55:46 (UTC+0)
Comment Actions
@Addshore
Does it mean we need to then de-abandon that change, or should we just create a new patch to re-enable these options? Why was it abandoned in the first place?
Addshore
added a comment.
Jun 8 2022, 6:41 PM
2022-06-08 18:41:18 (UTC+0)
Comment Actions
In
T238751#7988593
@ItamarWMDE
wrote:
@Addshore
Does it mean we need to then de-abandon that change, or should we just create a new patch to re-enable these options? Why was it abandoned in the first place?
I'm not sure if de-abandoning would work (not sure if there are conflicting changes since it was written), but that is certainly worth a try, and otherwise recreate it
gerritbot
added a comment.
Jun 9 2022, 2:58 PM
2022-06-09 14:58:54 (UTC+0)
Comment Actions
Change 552544
restored
by Itamar Givon:
[mediawiki/extensions/Wikidata.org@master] Only generate QS maxlag for pooled servers
ItamarWMDE
added a project:
wmde-wikidata-tech
Jun 16 2022, 2:43 PM
2022-06-16 14:43:13 (UTC+0)
ItamarWMDE
moved this task from
Radar
to
Doing
on the
User-ItamarWMDE
board.
Jun 16 2022, 2:49 PM
2022-06-16 14:49:52 (UTC+0)
Maintenance_bot
moved this task from
Blocked
to
Sorted Team A
on the
[DEPRECATED] wdwb-tech
board.
Jun 16 2022, 3:29 PM
2022-06-16 15:29:09 (UTC+0)
Gehel
edited projects, added
Discovery-Search
; removed
Discovery-Search (Current work)
Jul 18 2022, 3:13 PM
2022-07-18 15:13:12 (UTC+0)
Gehel
edited projects, added
Wikidata-Query-Service
; removed
Discovery-Search
Gehel
moved this task from
Incoming
to
Watching / Waiting
on the
Wikidata-Query-Service
board.
Joe
changed the task status from
Open
to
Stalled
Aug 12 2022, 5:13 AM
2022-08-12 05:13:15 (UTC+0)
Joe
removed
Joe
as the assignee of this task.
Comment Actions
Hi, any news on this front? I'll release this bug as its completion doesn't depend on me right now. When the functionality has been merged, please reassign to me.
ItamarWMDE
mentioned this in
T315423: Revive and merge patch to update maxlag calculation
Aug 17 2022, 9:42 AM
2022-08-17 09:42:45 (UTC+0)
MPhamWMF
mentioned this in
T315455: Investigate what caused our WDQS update lag to drop and remain below SLO on 28/07
Aug 22 2022, 2:57 PM
2022-08-22 14:57:34 (UTC+0)
dcausse
mentioned this in
T293063: Write and adapt Runbooks and cookbooks related to the WDQS Streaming Updater and kubernetes
Sep 1 2022, 4:38 PM
2022-09-01 16:38:04 (UTC+0)
gerritbot
added a comment.
Oct 10 2022, 2:24 PM
2022-10-10 14:24:45 (UTC+0)
Comment Actions
Change 841136 had a related patch set uploaded (by Hoo man; author: Hoo man):
[mediawiki/extensions/Wikidata.org@master] updateQueryServiceLag: Add lb(-pool) options for forward compatibility
gerritbot
added a comment.
Oct 11 2022, 10:23 AM
2022-10-11 10:23:50 (UTC+0)
Comment Actions
Change 841136
merged
by jenkins-bot:
[mediawiki/extensions/Wikidata.org@master] updateQueryServiceLag: Add lb(-pool) options for forward compatibility
ReleaseTaggerBot
added a project:
MW-1.40-notes (1.40.0-wmf.6; 2022-10-17)
Oct 11 2022, 11:00 AM
2022-10-11 11:00:39 (UTC+0)
gerritbot
added a comment.
Oct 11 2022, 12:32 PM
2022-10-11 12:32:00 (UTC+0)
Comment Actions
Change 841164 had a related patch set uploaded (by Hoo man; author: Hoo man):
[mediawiki/extensions/Wikidata.org@wmf/1.40.0-wmf.4] updateQueryServiceLag: Add lb(-pool) options for forward compatibility
gerritbot
added a comment.
Oct 11 2022, 12:32 PM
2022-10-11 12:32:31 (UTC+0)
Comment Actions
Change 841165 had a related patch set uploaded (by Hoo man; author: Hoo man):
[mediawiki/extensions/Wikidata.org@wmf/1.40.0-wmf.5] updateQueryServiceLag: Add lb(-pool) options for forward compatibility
gerritbot
added a comment.
Oct 11 2022, 1:56 PM
2022-10-11 13:56:33 (UTC+0)
Comment Actions
Change 841164
merged
by jenkins-bot:
[mediawiki/extensions/Wikidata.org@wmf/1.40.0-wmf.4] updateQueryServiceLag: Add lb(-pool) options for forward compatibility
Stashbot
added a comment.
Oct 11 2022, 1:56 PM
2022-10-11 13:56:48 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2022-10-11T13:56:47Z]
T315423
T238751
)]]
Stashbot
added a comment.
Oct 11 2022, 1:57 PM
2022-10-11 13:57:07 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2022-10-11T13:57:07Z]
T315423
T238751
)]] synced to the testservers: mwdebug1002.eqiad.wmnet, mwdebug2002.codfw.wmnet, mwdebug2001.codfw.wmnet, mwdebug1001.eqiad.wmnet
ReleaseTaggerBot
edited projects, added
MW-1.40-notes (1.40.0-wmf.4; 2022-10-03)
; removed
MW-1.40-notes (1.40.0-wmf.6; 2022-10-17)
Oct 11 2022, 2:00 PM
2022-10-11 14:00:51 (UTC+0)
Stashbot
added a comment.
Oct 11 2022, 2:01 PM
2022-10-11 14:01:45 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2022-10-11T14:01:45Z]
T315423
T238751
)]] (duration: 04m 57s)
gerritbot
added a comment.
Oct 11 2022, 2:19 PM
2022-10-11 14:19:29 (UTC+0)
Comment Actions
Change 841165
merged
by jenkins-bot:
[mediawiki/extensions/Wikidata.org@wmf/1.40.0-wmf.5] updateQueryServiceLag: Add lb(-pool) options for forward compatibility
ReleaseTaggerBot
edited projects, added
MW-1.40-notes (1.40.0-wmf.5; 2022-10-10)
; removed
MW-1.40-notes (1.40.0-wmf.4; 2022-10-03)
Oct 11 2022, 3:00 PM
2022-10-11 15:00:33 (UTC+0)
gerritbot
added a comment.
Oct 20 2022, 2:52 PM
2022-10-20 14:52:21 (UTC+0)
Comment Actions
Change 844993 had a related patch set uploaded (by Hoo man; author: Hoo man):
[mediawiki/extensions/Wikidata.org@master] Add an integration test for updateQueryServiceLag
gerritbot
added a comment.
Oct 20 2022, 7:57 PM
2022-10-20 19:57:03 (UTC+0)
Comment Actions
Change 845016 had a related patch set uploaded (by Hoo man; author: Addshore):
[mediawiki/extensions/Wikidata.org@wmf/1.40.0-wmf.6] Only generate QS maxlag for pooled servers
gerritbot
added a comment.
Oct 20 2022, 8:17 PM
2022-10-20 20:17:20 (UTC+0)
Comment Actions
Change 552544
merged
by jenkins-bot:
[mediawiki/extensions/Wikidata.org@master] Only generate QS maxlag for pooled servers
gerritbot
added a comment.
Oct 20 2022, 8:18 PM
2022-10-20 20:18:51 (UTC+0)
Comment Actions
Change 844993
merged
by jenkins-bot:
[mediawiki/extensions/Wikidata.org@master] Add an integration test for updateQueryServiceLag
gerritbot
added a comment.
Oct 20 2022, 8:51 PM
2022-10-20 20:51:54 (UTC+0)
Comment Actions
Change 845016
merged
by jenkins-bot:
[mediawiki/extensions/Wikidata.org@wmf/1.40.0-wmf.6] Only generate QS maxlag for pooled servers
Stashbot
added a comment.
Oct 20 2022, 8:59 PM
2022-10-20 20:59:38 (UTC+0)
Comment Actions
Mentioned in SAL (#wikimedia-operations)
[2022-10-20T20:59:37Z]
T315423
T238751
)]] (duration: 07m 12s)
hoo
closed this task as
Resolved
Oct 20 2022, 9:04 PM
2022-10-20 21:04:12 (UTC+0)
hoo
claimed this task.
ItamarWMDE
closed subtask
T315423: Revive and merge patch to update maxlag calculation
as
Resolved
Oct 24 2022, 1:18 PM
2022-10-24 13:18:25 (UTC+0)
Addshore
added a comment.
Oct 24 2022, 1:20 PM
2022-10-24 13:20:14 (UTC+0)
Comment Actions
Lucas_Werkmeister_WMDE
mentioned this in
T322010: Depool wdqs1007
Oct 31 2022, 9:45 AM
2022-10-31 09:45:32 (UTC+0)
Lucas_Werkmeister_WMDE
mentioned this in
T322030: Revert query service maxlag criteria from “most lagged” back to median-based implementation
Oct 31 2022, 2:30 PM
2022-10-31 14:30:29 (UTC+0)
gerritbot
added a comment.
Mar 5 2023, 4:35 PM
2023-03-05 16:35:58 (UTC+0)
Comment Actions
Change 553097
abandoned
by Majavah:
[operations/puppet@production] Update cron with lb and lb-pool params
Reason:
Log In to Comment
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct.
Wikimedia Foundation
Code of Conduct
Disclaimer
CC-BY-SA
GPL
Credits
US