vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #250
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.HthECpmP3x', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 69.51 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab: waiting for unit setup-gitlab.service17gitlab # Filesystem UUID: 6b306879-04df-4550-a3bf-b1a71bdabe2a18gitlab: waiting for the VM to finish booting19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bzc1x5h8h3ji5hjdfqksrjrqdzwi3m90-nixos-system-gitlab-test/init regInfo=/nix/store/gc8s240lk1wbspa2nqhzbmhhxj33d2lb-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/gc8s240lk1wbspa2nqhzbmhhxj33d2lb-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f40000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000030] arm-pv: using stolen time PV108gitlab # [ 0.000372] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000564] Console: colour dummy device 80x25110gitlab # [ 0.000571] printk: legacy console [tty0] enabled111gitlab # [ 0.000748] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000754] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000845] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000977] landlock: Up and running.115gitlab # [ 0.000980] Yama: becoming mindful.116gitlab # [ 0.001396] LSM support for eBPF active117gitlab # [ 0.001595] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001699] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002842] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003489] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003494] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003652] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004638] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004731] EFI services will not be available.125gitlab # [ 0.004926] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005570] Detected PIPT I-cache on CPU1127gitlab # [ 0.005668] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005792] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000129gitlab # [ 0.005915] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006987] Detected PIPT I-cache on CPU2131gitlab # [ 0.007091] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007213] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000133gitlab # [ 0.007335] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008428] Detected PIPT I-cache on CPU3135gitlab # [ 0.008545] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008666] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000137gitlab # [ 0.008791] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009328] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009355] SMP: Total of 4 processors activated.140gitlab # [ 0.009357] CPU: All CPU(s) started at EL1141gitlab # [ 0.009365] CPU features: detected: Branch Target Identification142gitlab # [ 0.009369] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009372] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009375] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009379] CPU features: detected: Common not Private translations146gitlab # [ 0.009381] CPU features: detected: CRC32 instructions147gitlab # [ 0.009383] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009387] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009390] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009392] CPU features: detected: E0PD151gitlab # [ 0.009394] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009397] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009400] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009402] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009405] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009409] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009412] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009415] CPU features: detected: Privileged Access Never159gitlab # [ 0.009417] CPU features: detected: PMUv3160gitlab # [ 0.009419] CPU features: detected: RAS Extension Support161gitlab # [ 0.009421] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009424] CPU features: detected: Random Number Generator163gitlab # [ 0.009426] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009429] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009431] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009435] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009574] alternatives: applying system-wide alternatives168gitlab # [ 0.012499] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012716] Memory: 5963732K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014166] devtmpfs: initialized171gitlab # [ 0.018382] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018448] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018635] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018640] 0 pages in range for non-PLT usage175gitlab # [ 0.018641] 508288 pages in range for PLT usage176gitlab # [ 0.018758] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019572] DMI not present or invalid.178gitlab # [ 0.022717] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025351] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.025637] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.027366] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.027390] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027692] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028115] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028119] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028123] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028126] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028128] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.028211] cpuidle: using governor ladder190gitlab # [ 0.028276] cpuidle: using governor menu191gitlab # [ 0.028476] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028709] ASID allocator initialised with 65536 entries193gitlab # [ 0.029790] Serial: AMBA PL011 UART driver194gitlab # [ 0.034825] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.035151] printk: console [ttyAMA0] enabled196gitlab # [ 0.047420] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.047442] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.047452] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.047460] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.047469] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.047477] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.047485] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.047493] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.059227] fbcon: Taking over console205gitlab # [ 0.059238] ACPI: Interpreter disabled.206gitlab # [ 0.060263] iommu: Default domain type: Translated207gitlab # [ 0.060268] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.069066] SCSI subsystem initialized209gitlab # [ 0.069402] usbcore: registered new interface driver usbfs210gitlab # [ 0.069425] usbcore: registered new interface driver hub211gitlab # [ 0.069458] usbcore: registered new device driver usb212gitlab # [ 0.069720] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.069724] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.069733] PTP clock support registered215gitlab # [ 0.069780] EDAC MC: Ver: 3.0.0216gitlab # [ 0.070161] scmi_core: SCMI protocol bus registered217gitlab # [ 0.070655] FPGA manager framework218gitlab # [ 0.071460] vgaarb: loaded219gitlab # [ 0.073362] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.073823] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.073847] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.078012] netfs: FS-Cache loaded223gitlab # [ 0.078687] pnp: PnP ACPI: disabled224gitlab # [ 0.088440] NET: Registered PF_INET protocol family225gitlab # [ 0.091059] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.150846] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.150918] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.150981] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.151410] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.152284] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.152414] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.152486] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.152661] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.152919] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.153045] NET: Registered PF_XDP protocol family236gitlab # [ 0.153068] PCI: CLS 0 bytes, default 64237gitlab # [ 0.153306] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.165744] kvm [1]: HYP mode not available239gitlab # [ 0.238176] Initialise system trusted keyrings240gitlab # [ 0.238463] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.239311] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.239450] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.254795] Key type asymmetric registered244gitlab # [ 0.254811] Asymmetric key parser 'x509' registered245gitlab # [ 0.254945] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.255187] io scheduler mq-deadline registered247gitlab # [ 0.255192] io scheduler kyber registered248gitlab # [ 0.262881] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.265492] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.265981] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.266011] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.266024] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.266031] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.266060] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.266085] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.266186] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.266195] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.266199] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.266203] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.266207] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.266338] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.267013] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.267308] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.267325] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.267360] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.267383] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.268088] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.268377] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.268393] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.268435] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.269113] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.269415] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.269431] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.269471] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.270173] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.270464] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.270479] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.270521] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.271175] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.271463] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.271478] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.271511] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.272166] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.272453] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.272468] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.272506] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.273189] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.273483] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.273498] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.273543] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.273559] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.274316] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.274620] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.274653] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.275325] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.275630] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.275663] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.276241] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.276542] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.276900] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.277288] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.277305] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.277338] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.278098] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.278399] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.278415] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.278456] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.279305] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.279313] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.279318] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.279380] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.279441] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.279498] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.279566] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.279636] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.279703] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.279771] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.279834] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.279899] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.279978] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.280040] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.280063] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.280086] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.280109] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.280138] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.280168] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.280191] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.280215] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.280239] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.280262] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.280286] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.280317] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.280346] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.280376] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.280398] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.280421] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.280449] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.280472] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.280496] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.280524] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.280548] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.280583] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.280590] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.280593] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.282466] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.297150] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.299810] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.302470] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.305097] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.308906] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.312858] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.315379] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.317921] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.320473] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.326612] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.329734] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.337035] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.339364] msm_serial: driver initialized359gitlab # [ 0.339531] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.339591] STM32 USART driver initialized361gitlab # [ 0.367379] loop: module loaded362gitlab # [ 0.367642] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.369929] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.372124] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.374337] virtio_blk virtio5: [vdb] 12204272 512-byte logical blocks (6.25 GB/5.82 GiB)366gitlab # [ 0.376713] megasas: 07.734.00.00-rc1367gitlab # [ 0.377625] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.379931] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.379949] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.382003] Using buffer write method371gitlab # [ 0.382046] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.384050] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.384068] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.385972] Using buffer write method375gitlab # [ 0.385990] Concatenating MTD devices:376gitlab # [ 0.385993] (0): "0.flash"377gitlab # [ 0.385995] (1): "0.flash"378gitlab # [ 0.385998] into device "0.flash"379gitlab # [ 0.577339] Freeing initrd memory: 27184K380gitlab # [ 0.595419] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.603846] thunder_xcv, ver 1.0382gitlab # [ 0.603976] thunder_bgx, ver 1.0383gitlab # [ 0.604039] nicpf, ver 1.0384gitlab # [ 0.605837] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.605849] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.605917] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.605932] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.606027] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.606036] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.606102] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.606201] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.606657] sky2: driver version 1.30393gitlab # [ 0.611524] usbcore: registered new interface driver usb-storage394gitlab # [ 0.612136] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.612137] ehci-pci 0000:00:0a.0: EHCI Host Controller396gitlab # [ 0.612206] usbserial: USB Serial support registered for generic397gitlab # [ 0.612223] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.612975] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.614068] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.616773] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.616834] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T08:16:12 UTC (1787213772)402gitlab # [ 0.617770] i2c_dev: i2c /dev entries driver403gitlab # [ 0.621484] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.623010] hub 1-0:1.0: USB hub found405gitlab # [ 0.623194] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.626098] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.626124] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.626919] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.628021] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.632713] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.633566] usbcore: registered new interface driver usbhid412gitlab # [ 0.633577] usbhid: USB HID core driver413gitlab # [ 0.643341] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.647926] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.648196] NET: Registered PF_INET6 protocol family416gitlab # [ 0.650205] Segment Routing with IPv6417gitlab # [ 0.650239] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.650394] NET: Registered PF_PACKET protocol family419gitlab # [ 0.650827] 9pnet: Installing 9P2000 support420gitlab # [ 0.654546] Key type dns_resolver registered421gitlab # [ 0.672013] registered taskstats version 1422gitlab # [ 0.672376] Loading compiled-in X.509 certificates423gitlab # [ 0.686526] Demotion targets for Node 0: null424gitlab # [ 0.686741] Key type .fscrypt registered425gitlab # [ 0.686747] Key type fscrypt-provisioning registered426gitlab # [ 0.686889] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.686910] ima: Allocated hash algorithm: sha1428gitlab # [ 0.686936] ima: No architecture policies found429gitlab # [ 0.687939] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.710369] clk: Disabling unused clocks431gitlab # [ 0.710392] PM: genpd: Disabling unused power domains432gitlab # [ 0.714576] Freeing unused kernel memory: 4736K433gitlab # [ 0.714791] Run /init as init process434gitlab # [ 0.743299] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.869456] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.026454] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.077741] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.077811] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.077896] systemd[1]: Detected architecture arm64.440gitlab # [ 1.077912] systemd[1]: Running in initrd.441gitlab # [ 1.078806] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.079067] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.161881] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.281440] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.312093] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.407608] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.424910] systemd[1]: Created slice Slice /system/modprobe.448gitlab # [ 1.425209] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.449gitlab # [ 1.425251] systemd[1]: Expecting device /dev/disk/by-label/nix-store...450gitlab # [ 1.425268] systemd[1]: Expecting device /dev/disk/by-label/nixos...451gitlab # [ 1.425295] systemd[1]: Reached target Path Units.452gitlab # [ 1.425314] systemd[1]: Reached target Slice Units.453gitlab # [ 1.425337] systemd[1]: Reached target Swaps.454gitlab # [ 1.425359] systemd[1]: Reached target Timer Units.455gitlab # [ 1.425989] systemd[1]: Listening on D-Bus System Message Bus Socket.456gitlab # [ 1.426394] systemd[1]: Listening on Journal Socket (/dev/log).457gitlab # [ 1.426870] systemd[1]: Listening on Journal Sockets.458gitlab # [ 1.427236] systemd[1]: Listening on udev Control Socket.459gitlab # [ 1.427509] systemd[1]: Listening on udev Kernel Socket.460gitlab # [ 1.427546] systemd[1]: Reached target Socket Units.461gitlab # [ 1.429847] systemd[1]: Starting Create List of Static Device Nodes...462gitlab # [ 1.432229] systemd[1]: Starting Load Kernel Module 9pnet_virtio...463gitlab # [ 1.432442] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs464gitlab # [ 1.434803] systemd[1]: Mounting Kernel Configuration File System...465gitlab # [ 1.438048] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2466gitlab # [ 1.438700] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0467gitlab # [ 1.460550] systemd[1]: Starting Journal Service...468gitlab # [ 1.466073] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.466237] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.473641] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.476057] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.477411] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.477970] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.478362] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.482066] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.510537] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.510825] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.510832] [drm] features: -context_init479gitlab # [ 1.516151] [drm] number of scanouts: 1480gitlab # [ 1.516184] [drm] number of cap sets: 0481gitlab # [ 1.518122] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic482gitlab # [ 1.518137] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0483gitlab # [ 1.525959] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.484gitlab # [ 1.529751] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.485gitlab # [ 1.530898] systemd-journald[94]: Collecting audit messages is disabled.486gitlab # [ 1.533592] Console: switching to colour frame buffer device 160x50487gitlab # [ 1.537586] systemd[1]: Starting Create Static Device Nodes in /dev...488gitlab # [ 1.537598] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev489gitlab # [ 1.547860] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.556246] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.557822] systemd[1]: Reached target Preparation for Local File Systems.492gitlab # [ 1.557882] systemd[1]: Reached target Local File Systems.493gitlab # [ 1.564084] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.590019] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.601682] systemd[1]: Starting Apply Kernel Variables...496gitlab # [ 1.612652] systemd[1]: Started Journal Service.497gitlab # [ 1.608733] systemd-modules-load[95]: Using 4 probe threads498gitlab # [ 1.611132] systemd-modules-load[95]: Module 'virtio_balloon' is built in499gitlab # [ 1.612354] systemd-modules-load[95]: Module 'virtio_console' is built in500gitlab # [ 1.614881] systemd-modules-load[95]: Module 'virtio_rng' is built in501gitlab # [ 1.616877] systemd-modules-load[95]: Inserted module 'dm_mod'502gitlab # [ 1.618310] systemd-modules-load[95]: Inserted module 'virtio_gpu'503gitlab # [ 1.619913] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.626152] systemd-udevd[105]: Using default interface naming scheme 'v261'.505gitlab # [ 1.627630] systemd[1]: Finished Apply Kernel Variables.506gitlab # [ 1.648382] systemd[1]: Started Rule-based Manager for Device Events and Files.507gitlab # [ 1.655812] systemd[1]: Finished Create System Files and Directories.508gitlab # [ 1.672527] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.708978] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.712795] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.116161] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.120208] systemd[1]: Reached target System Initialization.513gitlab # [ 2.121131] systemd[1]: Reached target Basic System.514gitlab # [ 2.328353] (udev-worker)[129]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.331296] (udev-worker)[129]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.338403] (udev-worker)[144]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.370407] systemd[1]: Found device /dev/disk/by-label/nix-store.518gitlab # [ 2.381519] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.384299] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.387057] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.441191] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.444905] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.471494] systemd[1]: Mounting /sysroot...524gitlab # [ 2.523623] EXT4-fs (vda): mounted filesystem 6b306879-04df-4550-a3bf-b1a71bdabe2a r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.522681] systemd[1]: Mounted /sysroot.526gitlab # [ 2.523857] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.525480] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.528433] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.544767] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.555046] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.557792] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.560209] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.568284] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.569460] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.584028] systemd[1]: Starting rw-sysroot-nix-store.service...536gitlab # [ 2.591664] systemd-sysroot-fstab-check[167]: /sysroot should be mounted in the initrd, will request daemon-reload.537gitlab # [ 2.603348] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.538gitlab # [ 2.608091] systemd[1]: Finished rw-sysroot-nix-store.service.539gitlab # [ 2.609775] systemd[1]: Reload requested from client PID 167 ('systemd-sysroot') (unit initrd-parse-etc.service)...540gitlab # [ 2.612187] systemd[1]: Reloading...541gitlab # [ 2.671186] erofs (device vdb): mounted with root inode @ nid 128.542gitlab # [ 2.731770] systemd[1]: Reloading finished in 121 ms.543gitlab # [ 2.780614] systemd-sysroot-fstab-check[167]: Requesting initrd-fs.target/start/replace...544gitlab # [ 2.783534] systemd[1]: Mounted /sysroot/nix/.ro-store.545gitlab # [ 2.784599] systemd[1]: Mounted /sysroot/tmp/shared.546gitlab # [ 2.785388] systemd[1]: Mounted /sysroot/tmp/xchg.547gitlab # [ 2.788455] systemd-sysroot-fstab-check[167]: Requesting swap.target/start/replace...548gitlab # [ 2.792335] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.794369] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.795838] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.797191] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.807200] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.808405] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.809440] systemd[1]: Mounting /sysroot/nix/store...555gitlab # [ 2.833546] systemd[1]: Mounted /sysroot/nix/store.556gitlab # [ 2.834367] systemd[1]: Reached target Initrd File Systems.557gitlab # [ 2.837833] systemd[1]: Starting Find NixOS closure...558gitlab # [ 2.839749] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...559gitlab # [ 2.871520] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.560gitlab # [ 2.882767] systemd[1]: Finished Find NixOS closure.561gitlab # [ 2.883579] systemd[1]: Reached target Initrd Default Target.562gitlab # [ 2.884613] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...563gitlab # [ 2.907466] systemd[1]: Stopped target Initrd Default Target.564gitlab # [ 2.908414] systemd[1]: Stopped target Basic System.565gitlab # [ 2.909152] systemd[1]: Stopped target Initrd Root Device.566gitlab # [ 2.909924] systemd[1]: Stopped target Path Units.567gitlab # [ 2.910612] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.568gitlab # [ 2.911643] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.569gitlab # [ 2.912800] systemd[1]: Stopped target Slice Units.570gitlab # [ 2.913496] systemd[1]: Stopped target Socket Units.571gitlab # [ 2.914192] systemd[1]: Stopped target System Initialization.572gitlab # [ 2.914994] systemd[1]: Stopped target Swaps.573gitlab # [ 2.915626] systemd[1]: Stopped target Timer Units.574gitlab # [ 2.916381] systemd[1]: dbus.socket: Deactivated successfully.575gitlab # [ 2.917211] systemd[1]: Closed D-Bus System Message Bus Socket.576gitlab # [ 2.918018] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.577gitlab # [ 2.919048] systemd[1]: Stopped Find NixOS closure.578gitlab # [ 2.919737] systemd[1]: Starting Load Kernel Module 9pnet_virtio...579gitlab # [ 2.920678] systemd[1]: Starting rw-sysroot-nix-store.service...580gitlab # [ 2.921490] systemd[1]: systemd-sysctl.service: Deactivated successfully.581gitlab # [ 2.922379] systemd[1]: Stopped Apply Kernel Variables.582gitlab # [ 2.923275] systemd[1]: systemd-modules-load.service: Deactivated successfully.583gitlab # [ 2.924417] systemd[1]: Stopped Load Kernel Modules.584gitlab # [ 2.925166] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.585gitlab # [ 2.926259] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.586gitlab # [ 2.927329] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.587gitlab # [ 2.928475] systemd[1]: Stopped Create System Files and Directories.588gitlab # [ 2.929362] systemd[1]: Stopped target Local File Systems.589gitlab # [ 2.930153] systemd[1]: Stopped target Preparation for Local File Systems.590gitlab # [ 2.931102] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.591gitlab # [ 2.932143] systemd[1]: Stopped Coldplug All udev Devices.592gitlab # [ 2.932932] systemd[1]: Stopping Rule-based Manager for Device Events and Files...593gitlab # [ 2.933982] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.594gitlab # [ 2.935138] systemd[1]: Stopped Virtual Console Setup.595gitlab # [ 2.935884] systemd[1]: initrd-cleanup.service: Deactivated successfully.596gitlab # [ 2.936931] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.597gitlab # [ 2.938995] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.598gitlab # [ 2.940587] systemd[1]: Finished Load Kernel Module 9pnet_virtio.599gitlab # [ 2.941795] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.600gitlab # [ 2.942812] systemd[1]: Finished rw-sysroot-nix-store.service.601gitlab # [ 2.950565] systemd[1]: systemd-udevd.service: Deactivated successfully.602gitlab # [ 2.951554] systemd[1]: Stopped Rule-based Manager for Device Events and Files.603gitlab # [ 2.953914] systemd[1]: systemd-udevd.service: Consumed 2.201s CPU time over 1.391s wall clock time, 28.2M memory peak.604gitlab # [ 2.955344] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.605gitlab # [ 2.956401] systemd[1]: Closed udev Control Socket.606gitlab # [ 2.957166] systemd[1]: Starting Cleanup udev Database...607gitlab # [ 2.958087] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.608gitlab # [ 2.959183] systemd[1]: Stopped Create Static Device Nodes in /dev.609gitlab # [ 2.960079] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.610gitlab # [ 2.961222] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.611gitlab # [ 2.962201] systemd[1]: kmod-static-nodes.service: Deactivated successfully.612gitlab # [ 2.963161] systemd[1]: Stopped Create List of Static Device Nodes.613gitlab # [ 2.992515] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.614gitlab # [ 2.994127] systemd[1]: Finished Cleanup udev Database.615gitlab # [ 2.995211] systemd[1]: Reached target Switch Root.616gitlab # [ 2.996379] systemd[1]: Starting NixOS Activation...617gitlab # [ 3.130945] initrd-nixos-activation-start[223]: booting system configuration /nix/store/bzc1x5h8h3ji5hjdfqksrjrqdzwi3m90-nixos-system-gitlab-test618gitlab # [ 3.192924] initrd-nixos-activation-start[223]: running activation script...619gitlab # [ 3.495889] initrd-nixos-activation-start[246]: setting up /etc...620gitlab # [ 3.622897] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.621gitlab # [ 3.625231] systemd[1]: Finished NixOS Activation.622gitlab # [ 3.627510] systemd[1]: Starting Switch Root...623gitlab # [ 3.683467] systemd[1]: Switching root.624gitlab # [ 3.834141] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).625gitlab # [ 4.450759] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)626gitlab # [ 4.450912] systemd[1]: Detected virtualization qemu.627gitlab # [ 4.451001] systemd[1]: Detected architecture arm64.628gitlab # [ 4.451205] systemd[1]: Detected first boot.629gitlab # [ 4.452709] systemd[1]: Initializing machine ID from random generator.630gitlab # [ 4.687363] systemd[1]: bpf-restrict-fs: LSM BPF program attached631gitlab # [ 4.807177] systemd[1]: Applying preset policy.632gitlab # [ 5.005760] systemd[1]: Populated /etc with preset unit settings.633gitlab # [ 5.151602] systemd[1]: initrd-switch-root.service: Deactivated successfully.634gitlab # [ 5.152401] systemd[1]: Stopped initrd-switch-root.service.635gitlab # [ 5.154782] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.636gitlab # [ 5.159510] systemd[1]: Created slice Slice /system/getty.637gitlab # [ 5.166698] systemd[1]: Created slice GitLab DevOps Platform Slice.638gitlab # [ 5.170463] systemd[1]: Created slice User and Session Slice.639gitlab # [ 5.171910] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.640gitlab # [ 5.173266] systemd[1]: Started Forward Password Requests to Wall Directory Watch.641gitlab # [ 5.174478] systemd[1]: Expecting device /dev/hvc0...642gitlab # [ 5.175541] systemd[1]: Expecting device /dev/ttyAMA0...643gitlab # [ 5.176639] systemd[1]: Reached target Local Encrypted Volumes.644gitlab # [ 5.177619] systemd[1]: Stopped target initrd-fs.target.645gitlab # [ 5.177942] systemd[1]: Stopped target initrd-root-fs.target.646gitlab # [ 5.178215] systemd[1]: Stopped target initrd-switch-root.target.647gitlab # [ 5.178480] systemd[1]: Reached target Virtual Machines and Containers.648gitlab # [ 5.178743] systemd[1]: Reached target Path Units.649gitlab # [ 5.179006] systemd[1]: Reached target Remote File Systems.650gitlab # [ 5.179257] systemd[1]: Reached target Slice Units.651gitlab # [ 5.179501] systemd[1]: Reached target Swaps.652gitlab # [ 5.180773] systemd[1]: Listening on Query the User Interactively for a Password.653gitlab # [ 5.182131] systemd[1]: Listening on Process Core Dump Socket.654gitlab # [ 5.183046] systemd[1]: Listening on Credential Encryption/Decryption.655gitlab # [ 5.184108] systemd[1]: Listening on Factory Reset Management.656gitlab # [ 5.184458] systemd[1]: Listening on Hostname Service Socket.657gitlab # [ 5.192270] systemd[1]: Starting Journal Log Access Socket...658gitlab # [ 5.193570] systemd[1]: Listening on Journal Audit Socket.659gitlab # [ 5.197861] systemd[1]: Listening on Console Output Muting Service Socket.660gitlab # [ 5.199552] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.661gitlab # [ 5.200715] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os662gitlab # [ 5.201802] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki663gitlab # [ 5.208102] systemd[1]: Listening on Disk Repartitioning Service Socket.664gitlab # [ 5.209543] systemd[1]: Listening on udev Control Socket.665gitlab # [ 5.210944] systemd[1]: Listening on udev Varlink Socket.666gitlab # [ 5.218965] systemd[1]: Mounting Huge Pages File System...667gitlab # [ 5.227440] systemd[1]: Mounting POSIX Message Queue File System...668gitlab # [ 5.266992] systemd[1]: Mounting Kernel Debug File System...669gitlab # [ 5.271697] systemd[1]: Mounting Kernel Trace File System...670gitlab # [ 5.278059] systemd[1]: Starting Create List of Static Device Nodes...671gitlab # [ 5.284920] systemd[1]: Starting Load Kernel Module 9pnet_virtio...672gitlab # [ 5.285817] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs673gitlab # [ 5.295602] systemd[1]: Mounting Kernel Configuration File System...674gitlab # [ 5.296414] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm675gitlab # [ 5.297162] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore676gitlab # [ 5.306819] systemd[1]: Starting Load Kernel Module fuse...677gitlab # [ 5.310377] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67678gitlab # [ 5.329577] systemd[1]: Starting Journal Service...679gitlab # [ 5.334363] systemd[1]: Starting Load Kernel Modules...680gitlab # [ 5.341557] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...681gitlab # [ 5.349544] systemd[1]: Starting Remount Root and Kernel File Systems...682gitlab # [ 5.350096] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os683gitlab # [ 5.354974] systemd-journald[318]: Collecting audit messages is enabled.684gitlab # [ 5.361929] systemd[1]: Starting Coldplug All udev Devices...685gitlab # [ 5.366506] systemd[1]: Listening on Journal Log Access Socket.686gitlab # [ 5.367250] systemd[1]: Mounted Huge Pages File System.687gitlab # [ 5.368090] systemd[1]: Mounted POSIX Message Queue File System.688gitlab # [ 5.368401] fuse: init (API version 7.45)689gitlab # [ 5.370659] systemd[1]: Mounted Kernel Debug File System.690gitlab # [ 5.371420] systemd[1]: Mounted Kernel Trace File System.691gitlab # [ 5.381728] systemd[1]: Finished Create List of Static Device Nodes.692gitlab # [ 5.382960] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.693gitlab # [ 5.383795] systemd[1]: Finished Load Kernel Module 9pnet_virtio.694gitlab # [ 5.378509] systemd[1]: Queued start job for default target Multi-User System.[ 5.384398] systemd[1]: Started Journal Service.695gitlab # 696gitlab # [ 5.399875] systemd[1]: Unnecessary job was removed for /dev/vdb.697gitlab # [ 5.405485] systemd[1]: systemd-journald.service: Deactivated successfully.698gitlab # [ 5.407190] systemd[1]: Mounted Kernel Configuration File System.699gitlab # [ 5.408658] systemd[1]: modprobe@fuse.service: Deactivated successfully.700gitlab # [ 5.410778] systemd[1]: Finished Load Kernel Module fuse.701gitlab # [ 5.412884] systemd-modules-load[319]: Using 3 probe threads702gitlab # [ 5.414273] systemd-modules-load[319]: Module 'atkbd' is built in703gitlab # [ 5.420551] EXT4-fs (vda): re-mounted 6b306879-04df-4550-a3bf-b1a71bdabe2a.704gitlab # [ 5.417599] systemd-modules-load[319]: Module 'loop' is built in705gitlab # [ 5.419011] systemd[1]: Mounting FUSE Control File System...706gitlab # [ 5.420467] systemd-modules-load[319]: Inserted module 'tls'707gitlab # [ 5.422501] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...708gitlab # [ 5.424168] systemd[1]: Finished Load Kernel Modules.709gitlab # [ 5.425701] systemd[1]: Starting Firewall...710gitlab # [ 5.427213] systemd[1]: Starting Apply Kernel Variables...711gitlab # [ 5.429233] systemd[1]: Finished Remount Root and Kernel File Systems.712gitlab # [ 5.434706] systemd[1]: Mounted FUSE Control File System.713gitlab # [ 5.445633] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.714gitlab # [ 5.449617] systemd[1]: Listening on Disk Image Download Service Socket.715gitlab # [ 5.450628] systemd[1]: Starting Flush Journal to Persistent Storage...716gitlab # [ 5.451614] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore717gitlab # [ 5.456440] systemd-oomd[321]: No swap; memory pressure usage will be degraded718gitlab # [ 5.458970] systemd[1]: Starting Load/Save OS Random Seed...719gitlab # [ 5.472741] systemd[1]: Starting Create Static Device Nodes in /dev...720gitlab # [ 5.474379] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 5.478981] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.722gitlab # [ 5.486946] systemd-journald[318]: Received client request to flush runtime journal.723gitlab # [ 5.506975] systemd[1]: Finished Apply Kernel Variables.724gitlab # [ 5.509946] systemd[1]: Finished Load/Save OS Random Seed.725gitlab # [ 5.510841] systemd[1]: Reached target First Boot Complete.726gitlab # [ 5.511794] systemd[1]: Finished Create Static Device Nodes in /dev.727gitlab # [ 5.513232] systemd[1]: Reached target Preparation for Local File Systems.728gitlab # [ 5.514280] systemd[1]: Starting Rule-based Manager for Device Events and Files...729gitlab # [ 5.515345] systemd[1]: Finished Flush Journal to Persistent Storage.730gitlab # [ 5.581506] systemd-udevd[359]: Using default interface naming scheme 'v261'.731gitlab # [ 5.616059] systemd[1]: Started Rule-based Manager for Device Events and Files.732gitlab # [ 5.796493] systemd[1]: Finished Firewall.733gitlab # [ 5.801385] systemd[1]: Starting Virtual Console Setup...734gitlab # [ 5.876800] systemd-vconsole-setup[481]: Configuration of first virtual console was skipped, ignoring remaining ones.735gitlab # [ 5.879496] systemd[1]: Finished Virtual Console Setup.736gitlab # [ 6.072082] systemd[1]: Finished Coldplug All udev Devices.737gitlab # [ 6.155998] systemd[1]: Mounting /run/wrappers...738gitlab # [ 6.156913] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs739gitlab # [ 6.206033] systemd[1]: Mounted /run/wrappers.740gitlab # [ 6.213366] systemd[1]: Reached target Local File Systems.741gitlab # [ 6.220308] systemd[1]: Listening on Boot Loader Control Service Socket.742gitlab # [ 6.225357] systemd[1]: Starting register-nix-paths.service...743gitlab # [ 6.231448] systemd[1]: Starting Create SUID/SGID Wrappers...744gitlab # [ 6.233894] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.745gitlab # [ 6.242462] (udev-worker)[408]: Network interface NamePolicy= disabled on kernel command line.746gitlab # [ 6.252100] systemd[1]: Starting Save Transient machine-id to Disk...747gitlab # [ 6.264620] (udev-worker)[437]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.748gitlab # [ 6.292445] systemd[1]: Starting Create System Files and Directories...749gitlab # [ 6.295948] (udev-worker)[437]: Network interface NamePolicy= disabled on kernel command line.750gitlab # [ 6.300457] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.751gitlab # [ 6.301701] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.752gitlab # [ 6.309263] systemd[1]: Condition check resulted in Virtio network device being skipped.753gitlab # [ 6.310557] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore754gitlab # [ 6.312305] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.755gitlab # [ 6.314318] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67756gitlab # [ 6.317085] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore757gitlab # [ 6.319557] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os758gitlab # [ 6.322502] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os759gitlab # [ 6.328909] systemd[1]: Finished Create System Files and Directories.760gitlab # [ 6.330209] systemd[1]: Starting Rebuild Journal Catalog...761gitlab # [ 6.331281] systemd[1]: Starting Record System Boot/Shutdown in UTMP...762gitlab # [ 6.335175] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.763gitlab # [ 6.336531] systemd[1]: Finished Save Transient machine-id to Disk.764gitlab # [ 6.359831] systemd[1]: Finished Record System Boot/Shutdown in UTMP.765gitlab # [ 6.376627] systemd[1]: Finished Rebuild Journal Catalog.766gitlab # [ 6.380346] systemd[1]: Starting Update is Completed...767gitlab # [ 6.402082] systemd[1]: Finished Update is Completed.768gitlab # [ 6.434196] mousedev: PS/2 mouse device common for all mice769gitlab # [ 6.463161] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.770gitlab # [ 6.464588] systemd[1]: Finished Create SUID/SGID Wrappers.771gitlab # [ 6.465502] systemd[1]: suid-sgid-wrappers.service: Consumed 145ms CPU time over 232ms wall clock time, 6.2M memory peak, 1.9M read from disk.772gitlab # [ 6.708327] systemd[1]: Finished register-nix-paths.service.773gitlab # [ 6.711133] systemd[1]: Reached target System Initialization.774gitlab # [ 6.712117] systemd[1]: Started Discard unused filesystem blocks once a week.775gitlab # [ 6.713191] systemd[1]: Started logrotate.timer.776gitlab # [ 6.713926] systemd[1]: Started Daily Cleanup of Temporary Directories.777gitlab # [ 6.714888] systemd[1]: Reached target Timer Units.778gitlab # [ 6.715641] systemd[1]: Listening on D-Bus System Message Bus Socket.779gitlab # [ 6.718183] systemd[1]: Listening on Nix Daemon Socket.780gitlab # [ 6.728121] systemd[1]: Starting nixbot CI service socket...781gitlab # [ 6.729048] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.782gitlab # [ 6.731757] systemd[1]: Starting D-Bus System Message Bus...783gitlab # [ 6.732801] systemd[1]: Listening on nixbot CI service socket.784gitlab # [ 6.733690] systemd[1]: Reached target Socket Units.785gitlab # [ 6.763293] dbus-broker-launch[568]: Looking up NSS user entry for 'systemd-timesync'...786gitlab # [ 6.765876] dbus-broker-launch[568]: NSS returned no entry for 'systemd-timesync'787gitlab # [ 6.767744] dbus-broker-launch[568]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"788gitlab # [ 6.771258] systemd[1]: Started D-Bus System Message Bus.789gitlab # [ 6.778984] dbus-broker-launch[568]: Ready790gitlab # [ 6.779850] systemd[1]: Reached target Basic System.791gitlab # [ 6.784317] systemd[1]: Started backdoor.service.792gitlab # [ 6.791383] systemd[1]: Starting gitlab-config.service...793gitlab # [ 6.804215] systemd[1]: Starting Import lastlog data into lastlog2 database...794gitlab # [ 6.808802] systemd[1]: Starting Logrotate configuration check...795gitlab # [ 6.823011] systemd[1]: Starting Name Service Cache Daemon (nsncd)...796gitlab # [ 6.824411] systemd[1]: Starting Post-Boot Actions...797gitlab # [ 6.825501] logrotate[575]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.798gitlab # connecting to host...799gitlab # [ 6.828715] logrotate[575]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf800gitlab # [ 6.830048] logrotate[575]: note: 'monthly' overrides previously specified 'weekly'801gitlab # [ 6.831049] logrotate[575]: Reading state from file: /var/lib/logrotate.status802gitlab # [ 6.832005] logrotate[575]: state file /var/lib/logrotate.status does not exist803gitlab # [ 6.833105] logrotate[575]: Allocating hash table for state file, size 64 entries804gitlab # [ 6.834079] logrotate[575]: Handling 4 logs805gitlab # [ 6.834654] logrotate[575]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed806gitlab # [ 6.837056] logrotate[575]: considering log /var/log/btmp807gitlab # [ 6.837800] logrotate[575]: Creating new state808gitlab # [ 6.838442] logrotate[575]: Now: 2026-08-20 08:16809gitlab # [ 6.839076] logrotate[575]: Last rotated at 2026-08-20 08:00810gitlab: Guest shell says: b'Spawning backdoor root shell...\n'811gitlab # [ 6.844211] logrotate[575]: log does not need rotating (log has already been rotated)812gitlab # [ 6.845465] logrotate[575]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed813gitlab # [ 6.847398] logrotate[575]: considering log /var/log/wtmp814gitlab: connected to guest root shell815gitlab # [ 6.851057] logrotate[575]: Creating new state816gitlab: (connecting took 7.30 seconds)817gitlab # [ 6.852654] logrotate[575]: Now: 2026-08-20 08:16818gitlab: (finished: waiting for the VM to finish booting, in 7.30 seconds)819gitlab # [ 6.853279] logrotate[575]: Last rotated at 2026-08-20 08:00820gitlab # [ 6.854012] logrotate[575]: log does not need rotating (log has already been rotated)821gitlab # [ 6.854955] logrotate[575]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed822gitlab # [ 6.858838] logrotate[575]: switching euid from 0 to 165 and egid from 0 to 165 (pid 575)823gitlab # [ 6.859990] logrotate[575]: considering log /var/gitlab/state/log/*.log824gitlab # [ 6.861616] logrotate[575]: log /var/gitlab/state/log/*.log does not exist -- skipping825gitlab # [ 6.864129] logrotate[575]: Creating new state826gitlab # [ 6.864723] logrotate[575]: switching euid from 165 to 0 and egid from 165 to 0 (pid 575)827gitlab # [ 6.867504] logrotate[575]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed828gitlab # [ 6.869388] logrotate[575]: switching euid from 0 to 60 and egid from 0 to 60 (pid 575)829gitlab # [ 6.870666] logrotate[575]: considering log /var/log/nginx/*.log830gitlab # [ 6.871480] logrotate[575]: log /var/log/nginx/*.log does not exist -- skipping831gitlab # [ 6.875149] logrotate[575]: Creating new state832gitlab # [ 6.883365] logrotate[575]: not running postrotate script, since no logs were rotated833gitlab # [ 6.884503] logrotate[575]: switching euid from 60 to 0 and egid from 60 to 0 (pid 575)834gitlab # [ 6.886085] systemd[1]: Started Reset console on configuration changes.835gitlab # [ 6.887242] systemd[1]: Starting resolvconf update...836gitlab # [ 6.890565] systemd[1]: Finished Logrotate configuration check.837gitlab # [ 6.891651] systemd[1]: Finished Post-Boot Actions.838gitlab # [ 6.894803] systemd[1]: Finished Import lastlog data into lastlog2 database.839gitlab # [ 6.895971] systemd[1]: Started Name Service Cache Daemon (nsncd).840gitlab # [ 6.899553] systemd[1]: Reached target Host and Network Name Lookups.841gitlab # [ 6.901720] nsncd[576]: Aug 20 08:16:18.786 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"842gitlab # [ 6.903880] systemd[1]: Reached target User and Group Name Lookups.843gitlab # [ 6.924814] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3844gitlab # [ 6.921611] systemd[1]: Starting User Login Management...845gitlab # [ 7.017223] systemd[1]: Stopped target Host and Network Name Lookups.846gitlab # [ 7.019539] systemd[1]: Stopping Host and Network Name Lookups...847gitlab # [ 7.020564] systemd[1]: Stopped target User and Group Name Lookups.848gitlab # [ 7.021440] systemd[1]: Stopping User and Group Name Lookups...849gitlab # [ 7.022242] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...850gitlab # [ 7.023140] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.851gitlab # [ 7.030027] systemd[1]: Stopped Virtual Console Setup.852gitlab # [ 7.031340] systemd[1]: systemd-vconsole-setup.service: Consumed 37ms CPU time over 1.216s wall clock time, 3.2M memory peak, 1.1M read from disk.853gitlab # [ 7.037981] systemd[1]: Stopping Virtual Console Setup...854gitlab # [ 7.039294] systemd-logind[624]: New seat seat0.855gitlab # [ 7.043153] systemd[1]: Starting Virtual Console Setup...856gitlab # [ 7.044150] systemd-logind[624]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)857gitlab # [ 7.045579] systemd-logind[624]: Watching system buttons on /dev/input/event0 (gpio-keys)858gitlab # [ 7.046689] systemd[1]: Started User Login Management.859gitlab # [ 7.047412] systemd[1]: nscd.service: Deactivated successfully.860gitlab # [ 7.052603] systemd[1]: Stopped Name Service Cache Daemon (nsncd).861gitlab # [ 7.054223] systemd[1]: nscd.service: Consumed 29ms CPU time over 213ms wall clock time, 7.5M memory peak, 5.8M read from disk.862gitlab # [ 7.064330] systemd[1]: Starting linger-users.service...863gitlab # [ 7.065612] systemd-vconsole-setup[664]: Configuration of first virtual console was skipped, ignoring remaining ones.864gitlab # [ 7.069143] systemd-logind[624]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)865gitlab # [ 7.073851] systemd[1]: Starting Name Service Cache Daemon (nsncd)...866gitlab # [ 7.076245] systemd[1]: Finished resolvconf update.867gitlab # [ 7.078837] systemd[1]: Finished Virtual Console Setup.868gitlab # [ 7.081525] systemd[1]: Reached target Preparation for Network.869gitlab # [ 7.088004] systemd[1]: Starting DHCP Client...870gitlab # [ 7.093055] systemd[1]: Starting Address configuration of eth1...871gitlab # [ 7.095252] nsncd[683]: Aug 20 08:16:18.983 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"872gitlab # [ 7.098150] systemd[1]: Starting Extra networking commands....873gitlab # [ 7.099267] systemd[1]: Started Name Service Cache Daemon (nsncd).874gitlab # [ 7.100890] systemd[1]: linger-users.service: Deactivated successfully.875gitlab # [ 7.102056] systemd[1]: Finished linger-users.service.876gitlab # [ 7.107188] systemd[1]: Reached target Host and Network Name Lookups.877gitlab # [ 7.108812] systemd[1]: Reached target User and Group Name Lookups.878gitlab # [ 7.120829] network-addresses-eth1-start[688]: adding address 192.168.1.1/24... done879gitlab # [ 7.126770] network-addresses-eth1-start[688]: adding address 2001:db8:1::1/64... done880gitlab # [ 7.134373] systemd[1]: Finished Address configuration of eth1.881gitlab # [ 7.176416] systemd[1]: Finished Extra networking commands..882gitlab # [ 7.177513] systemd[1]: Reached target Network.883gitlab # [ 7.179262] dhcpcd[717]: dhcpcd-10.3.2 starting884gitlab # [ 7.181274] systemd[1]: Starting gitlab-workhorse.service...885gitlab # [ 7.184262] dhcpcd[764]: dev: loaded udev886gitlab # [ 7.185932] systemd[1]: Starting Nginx Web Server...887gitlab # [ 7.192269] systemd[1]: Starting PostgreSQL Server...888gitlab # [ 7.196161] systemd[1]: Starting Redis Server - redis-gitlab...[ 7.201326] 8021q: 802.1Q VLAN Support v1.8889gitlab # 890gitlab # [ 7.203902] 8021q: adding VLAN 0 to HW filter on device eth1891gitlab # [ 7.202176] systemd[1]: Starting Permit User Sessions...892gitlab # [ 7.214119] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.893gitlab # [ 7.248026] cfg80211: Loading compiled-in X.509 certificates for regulatory database894gitlab # [ 7.257044] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'895gitlab # [ 7.257725] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'896gitlab # [ 7.259577] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2897gitlab # [ 7.252233] systemd[1]: Finished Permit User Sessions.[ 7.259885] cfg80211: failed to load regulatory.db898gitlab # 899gitlab # [ 7.279155] systemd[1]: Started Getty on tty1.900gitlab # [ 7.279934] systemd[1]: Reached target Login Prompts.901gitlab # [ 7.306908] 8021q: adding VLAN 0 to HW filter on device eth0902gitlab # [ 7.302905] dhcpcd[764]: eth0: waiting for carrier903gitlab # [ 7.308080] dhcpcd[764]: eth0: carrier acquired904gitlab # [ 7.312317] dhcpcd[764]: DUID 00:01:00:01:32:19:74:53:52:54:00:12:34:56905gitlab # [ 7.313410] dhcpcd[764]: eth0: IAID 00:12:34:56906gitlab # [ 7.314249] dhcpcd[764]: eth0: adding address fe80::5054:ff:fe12:3456907gitlab # [ 7.356570] nginx-pre-start[793]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok908gitlab # [ 7.358490] nginx-pre-start[793]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful909gitlab # [ 7.364492] systemd[1]: Started Nginx Web Server.910gitlab # [ 7.404830] redis-server[797]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.911gitlab # [ 7.407331] redis-server[797]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo912gitlab # [ 7.409065] redis-server[797]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=797, just started913gitlab # [ 7.410736] redis-server[797]: Configuration loaded914gitlab # [ 7.411680] redis[797]: monotonic clock: ARM CNTVCT @ 1000 ticks/us915gitlab # [ 7.413530] postgresql-pre-start[802]: The files belonging to this database system will be owned by user "postgres".916gitlab # [ 7.415415] postgresql-pre-start[802]: This user must also own the server process.917gitlab # [ 7.416673] redis[797]: Running mode=standalone, port=0.918gitlab # [ 7.417657] systemd[1]: Started Redis Server - redis-gitlab.919gitlab # [ 7.418576] postgresql-pre-start[802]: The database cluster will be initialized with locale "en_US.UTF-8".920gitlab # [ 7.419908] postgresql-pre-start[802]: The default database encoding has accordingly been set to "UTF8".921gitlab # [ 7.421582] postgresql-pre-start[802]: The default text search configuration will be set to "english".922gitlab # [ 7.422961] postgresql-pre-start[802]: Data page checksums are enabled.923gitlab # [ 7.423960] postgresql-pre-start[802]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok924gitlab # [ 7.425609] postgresql-pre-start[802]: creating subdirectories ... ok925gitlab # [ 7.426592] postgresql-pre-start[802]: selecting dynamic shared memory implementation ... posix926gitlab # [ 7.428029] redis[797]: Server initialized927gitlab # [ 7.428844] redis[797]: Ready to accept connections unix928gitlab # [ 7.429820] redis[797]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.929gitlab # [ 7.461683] postgresql-pre-start[802]: selecting default "max_connections" ... 100930gitlab # [ 7.512302] postgresql-pre-start[802]: selecting default "shared_buffers" ... 128MB931gitlab # [ 7.562628] dhcpcd[764]: eth0: soliciting a DHCP lease932gitlab # [ 7.588581] dhcpcd[764]: eth0: offered 10.0.2.15 from 10.0.2.2933gitlab # [ 7.612242] dhcpcd[764]: eth0: probing address 10.0.2.15/24934gitlab # [ 7.822531] systemd[1]: Started gitlab-workhorse.service.935gitlab # [ 7.997445] postgresql-pre-start[802]: selecting default time zone ... UTC936gitlab # [ 8.002919] postgresql-pre-start[802]: creating configuration files ... ok937gitlab # [ 8.084656] gitlab-workhorse[825]: time="2026-08-20T08:16:19Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4938gitlab # [ 8.086344] gitlab-workhorse[825]: time="2026-08-20T08:16:19Z" level=info msg="Using redis/go-redis"939gitlab # [ 8.087560] gitlab-workhorse[825]: time="2026-08-20T08:16:19Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix940gitlab # [ 8.239970] postgresql-pre-start[802]: running bootstrap script ... ok941gitlab # [ 8.981126] postgresql-pre-start[802]: performing post-bootstrap initialization ... ok942gitlab # [ 9.251609] postgresql-pre-start[802]: syncing data to disk ... ok943gitlab # [ 9.254904] postgresql-pre-start[802]: initdb: warning: enabling "trust" authentication for local connections944gitlab # [ 9.259179] postgresql-pre-start[802]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.945gitlab # [ 9.266190] postgresql-pre-start[802]: Success. You can now start the database server using:946gitlab # [ 9.269993] postgresql-pre-start[802]: pg_ctl -D /var/lib/postgresql/18 -l logfile start947gitlab # [ 9.471051] postgres[859]: [859] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit948gitlab # [ 9.476745] postgres[859]: [859] LOG: listening on IPv6 address "::1", port 5432949gitlab # [ 9.479989] postgres[859]: [859] LOG: listening on IPv4 address "127.0.0.1", port 5432950gitlab # [ 9.483632] postgres[859]: [859] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"951gitlab # [ 9.491901] postgres[868]: [868] LOG: database system was shut down at 2026-08-20 08:16:20 GMT952gitlab # [ 9.505093] postgres[859]: [859] LOG: database system is ready to accept connections953gitlab # [ 9.509752] systemd[1]: Started PostgreSQL Server.954gitlab # [ 9.517705] systemd[1]: Starting PostgreSQL Setup Scripts...955gitlab # [ 9.841252] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: mkdir -p /var/gitlab/state/home/.ssh: OK956gitlab # [ 9.845591] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[879]: chmod 700 /var/gitlab/state/home/.ssh: OK957gitlab # [ 9.861360] dhcpcd[764]: eth0: soliciting an IPv6 router958gitlab # [ 9.863692] dhcpcd[764]: eth0: Router Advertisement from fe80::2959gitlab # [ 9.866511] dhcpcd[764]: eth0: adding address fec0::5054:ff:fe12:3456/64960gitlab # [ 9.869338] dhcpcd[764]: eth0: adding route to fec0::/64961gitlab # [ 9.872386] postgresql-setup-start[883]: CREATE DATABASE962gitlab # [ 9.874873] dhcpcd[764]: eth0: adding default route via fe80::2963gitlab # [ 9.919465] postgresql-setup-start[896]: CREATE ROLE964gitlab # [ 9.940080] postgresql-setup-start[901]: ALTER DATABASE965gitlab # [ 9.969027] systemd[1]: Finished gitlab-config.service.966gitlab # [ 9.977297] systemd[1]: Started gitaly.service.967gitlab # [ 9.983841] postgresql-setup-start[907]: CREATE ROLE968gitlab # [ 9.989603] systemd[1]: Finished PostgreSQL Setup Scripts.969gitlab # [ 9.991283] systemd[1]: Reached target PostgreSQL.970gitlab # [ 9.995661] systemd[1]: Starting gitlab-db-config.service...971gitlab # [ 10.001077] systemd[1]: Starting gitlab-postgresql.service...972gitlab # [ 10.195509] gitlab-postgresql-start[920]: CREATE DATABASE973gitlab # [ 10.320218] gitlab-postgresql-start[940]: CREATE EXTENSION974gitlab # [ 10.501057] gitlab-postgresql-start[942]: CREATE EXTENSION975gitlab # [ 10.506225] systemd[1]: Finished gitlab-postgresql.service.976gitlab # [ 10.906484] gitaly[910]: time="2026-08-20T08:16:22.791Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=910977gitlab # [ 10.924908] gitaly[910]: time="2026-08-20T08:16:22.794Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=910978gitlab # [ 10.928579] gitaly[910]: time="2026-08-20T08:16:22.794Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=910979gitlab # [ 10.932880] gitaly[910]: time="2026-08-20T08:16:22.794Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=910980gitlab # [ 10.936328] gitaly[910]: time="2026-08-20T08:16:22.795Z" level=info msg="Starting Gitaly" pid=910 version=981gitlab # [ 11.260200] gitaly[910]: time="2026-08-20T08:16:23.147Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=348 pid=910982gitlab # [ 11.262235] gitaly[910]: time="2026-08-20T08:16:23.149Z" level=info msg="finished initializing bootstrap" duration_ms=1 pid=910983gitlab # [ 11.263782] gitaly[910]: time="2026-08-20T08:16:23.149Z" level=info msg="finished initializing command factory" duration_ms=0 pid=910984gitlab # [ 11.265405] gitaly[910]: time="2026-08-20T08:16:23.149Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-910/git-exec-3015838195.d/git pid=910985gitlab # [ 11.267700] gitaly[910]: time="2026-08-20T08:16:23.156Z" level=info msg="finished detecting git version" duration_ms=6 pid=910986gitlab # [ 11.269589] gitaly[910]: time="2026-08-20T08:16:23.156Z" level=info msg="using Git version" pid=910 version=2.53.g987gitlab # [ 11.271013] gitaly[910]: time="2026-08-20T08:16:23.156Z" level=info msg="clearing disk cache object folder" pid=910 storage=default988gitlab # [ 11.272578] gitaly[910]: time="2026-08-20T08:16:23.157Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache508267816 pid=910 storage=default989gitlab # [ 11.274877] gitaly[910]: time="2026-08-20T08:16:23.157Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache508267816 pid=910 storage=default990gitlab # [ 11.277644] gitaly[910]: time="2026-08-20T08:16:23.157Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=910991gitlab # [ 11.280067] gitaly[910]: time="2026-08-20T08:16:23.157Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=910992gitlab # [ 11.282886] gitaly[910]: time="2026-08-20T08:16:23.157Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache508267816 clear_duration_ms=0 pid=910 storage=default993gitlab # [ 11.295382] gitaly[910]: time="2026-08-20T08:16:23.183Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=910994gitlab # [ 11.298211] gitaly[910]: time="2026-08-20T08:16:23.184Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=910 schema=unix995gitlab # [ 11.300436] gitaly[910]: time="2026-08-20T08:16:23.184Z" level=info msg="listening at address" address=/run/gitaly/gitaly-910/sock.d/intern pid=910 schema=unix996gitlab # [ 11.302330] gitaly[910]: time="2026-08-20T08:16:23.183Z" level=info msg="counting repositories" pid=910997gitlab # [ 11.303545] gitaly[910]: time="2026-08-20T08:16:23.185Z" level=info msg="starting to count repositories" pid=910 storage_path=/var/gitlab/state/repositories998gitlab # [ 11.305584] gitaly[910]: time="2026-08-20T08:16:23.186Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=910 storage_path=/var/gitlab/state/repositories999gitlab # [ 11.307566] gitaly[910]: time="2026-08-20T08:16:23.186Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9101000gitlab # [ 11.309461] gitaly[910]: time="2026-08-20T08:16:23.184Z" level=info msg="finished tempdir cleaner walk" pid=910 storage=default time_ms=01001gitlab # [ 11.311187] gitaly[910]: time="2026-08-20T08:16:23.188Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9101002gitlab # [ 11.312820] gitaly[910]: time="2026-08-20T08:16:23.188Z" level=info msg="Started Gitaly" duration_ms=393 pid=9101003gitlab # [ 11.314389] gitaly[910]: time="2026-08-20T08:16:23.189Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9101004gitlab # [ 11.316060] gitaly[910]: time="2026-08-20T08:16:23.190Z" level=info msg="maintenance: daily scheduled" pid=910 scheduled="2026-08-20 12:00:00 +0000 UTC"1005gitlab # [ 12.551388] dhcpcd[764]: eth0: leased 10.0.2.15 for 86400 seconds1006gitlab # [ 12.555077] dhcpcd[764]: eth0: adding route to 10.0.2.0/241007gitlab # [ 12.558107] dhcpcd[764]: eth0: adding default route via 10.0.2.21008gitlab # [ 12.690590] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1009gitlab # [ 12.695284] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1010gitlab # [ 12.708873] systemd[1]: Started DHCP Client.1011gitlab # [ 12.711477] systemd[1]: Reached target Network is Online.1012gitlab # [ 12.720663] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 15.132285] gitaly[910]: time="2026-08-20T08:16:27.019Z" level=info msg="License database preloaded" duration_ms=4224 pid=9101014gitlab # [ 57.314775] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[918]: W, [2026-08-20T08:17:09.201945 #918] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1015gitlab # [ 58.152226] gitlab-workhorse[825]: time="2026-08-20T08:17:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1016gitlab # [ 60.335207] postgres[1447]: [1447] ERROR: relation "feature_gates" does not exist at character 5231017gitlab # [ 60.335610] postgres[1447]: [1447] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1018gitlab # [ 60.335738] postgres[1447]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1019gitlab # [ 60.335857] postgres[1447]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1020gitlab # [ 60.335974] postgres[1447]: attidentity AS identity,1021gitlab # [ 60.336182] postgres[1447]: attgenerated as attgenerated1022gitlab # [ 60.336330] postgres[1447]: FROM pg_attribute a1023gitlab # [ 60.336478] postgres[1447]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1024gitlab # [ 60.336598] postgres[1447]: LEFT JOIN pg_type t ON a.atttypid = t.oid1025gitlab # [ 60.336712] postgres[1447]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1026gitlab # [ 60.336827] postgres[1447]: WHERE a.attrelid = '"feature_gates"'::regclass1027gitlab # [ 60.336946] postgres[1447]: AND a.attnum > 0 AND NOT a.attisdropped1028gitlab # [ 60.337060] postgres[1447]: ORDER BY a.attnum1029gitlab # [ 60.337174] postgres[1447]:1030gitlab # [ 65.441842] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1494]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1031gitlab # [ 65.442242] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1494]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1032gitlab # [ 68.162882] gitlab-workhorse[825]: time="2026-08-20T08:17:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1033gitlab # [ 78.163255] gitlab-workhorse[825]: time="2026-08-20T08:17:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1034gitlab # [ 88.170578] gitlab-workhorse[825]: time="2026-08-20T08:17:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 91.332976] postgres[1597]: [1597] ERROR: relation "table_without_models" does not exist1036gitlab # [ 91.333360] postgres[1597]: [1597] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1037gitlab # [ 98.178556] gitlab-workhorse[825]: time="2026-08-20T08:17:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 108.179787] gitlab-workhorse[825]: time="2026-08-20T08:18:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 118.191058] gitlab-workhorse[825]: time="2026-08-20T08:18:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 121.136562] systemd[1]: Finished gitlab-db-config.service.1041gitlab # [ 121.143177] systemd[1]: Started gitlab-sidekiq.service.1042gitlab # [ 121.150050] systemd[1]: Starting gitlab.service...1043gitlab # [ 121.734783] bundle[1973]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1044gitlab # [ 121.741414] bundle[1973]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1045gitlab # [ 121.747419] bundle[1973]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1046gitlab # [ 126.314624] sidekiq-cluster[1972]: {"severity":"INFO","time":"2026-08-20T08:18:18.162Z","message":"Starting cluster with 1 processes"}1047gitlab # [ 126.544895] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.401Z","pid":1973,"message":"* Enabling systemd notification integration"}1048gitlab # [ 126.549985] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"Puma starting in cluster mode..."}1049gitlab # [ 126.554488] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1050gitlab # [ 126.559376] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1051gitlab # [ 126.565560] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Min threads: 0"}1052gitlab # [ 126.569534] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Max threads: 4"}1053gitlab # [ 126.573582] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Environment: production"}1054gitlab # [ 126.577808] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Master PID: 1973"}1055gitlab # [ 126.581831] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Workers: 2"}1056gitlab # [ 126.585793] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1057gitlab # [ 126.590897] bundle[1973]: {"timestamp":"2026-08-20T08:18:18.432Z","pid":1973,"message":"* Preloading application"}1058gitlab # [ 128.192876] gitlab-workhorse[825]: time="2026-08-20T08:18:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1059gitlab # [ 138.202296] gitlab-workhorse[825]: time="2026-08-20T08:18:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1060gitlab # [ 148.210427] gitlab-workhorse[825]: time="2026-08-20T08:18:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 158.211514] gitlab-workhorse[825]: time="2026-08-20T08:18:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 165.616729] bundle[1973]: W, [2026-08-20T08:18:57.503906 #1973] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1063gitlab # [ 168.230178] gitlab-workhorse[825]: time="2026-08-20T08:19:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 168.980226] sidekiq-cluster[2022]: 2026-08-20T08:19:00.867Z pid=2022 tid=wni INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2022, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427839488}1065gitlab # [ 169.279567] sidekiq-cluster[2022]: W, [2026-08-20T08:19:01.167726 #2022] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1066gitlab # [ 169.427327] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:01.315Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1067gitlab # [ 172.914688] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.801Z","message":"GitLab reliable fetch activated!"}1068gitlab # [ 172.915052] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.802Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1069gitlab # [ 172.960897] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.849Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1070gitlab # [ 172.967764] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.856Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1071gitlab # [ 172.974306] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.862Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1072gitlab # [ 172.980493] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.868Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1073gitlab # [ 172.986292] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.874Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1074gitlab # [ 172.991563] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.879Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1075gitlab # [ 172.995440] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.883Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1076gitlab # [ 172.998829] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.887Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1077gitlab # [ 173.002202] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.890Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1078gitlab # [ 173.005448] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.893Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1079gitlab # [ 173.008619] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.896Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1080gitlab # [ 173.012611] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.901Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1081gitlab # [ 173.015757] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.904Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1082gitlab # [ 173.018793] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.907Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1083gitlab # [ 173.022319] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.910Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1084gitlab # [ 173.025764] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.914Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1085gitlab # [ 173.029912] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.918Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1086gitlab # [ 173.034250] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.922Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1087gitlab # [ 173.037826] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.926Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1088gitlab # [ 173.041234] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.929Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1089gitlab # [ 173.044722] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.933Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1090gitlab # [ 173.047893] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.935Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1091gitlab # [ 173.050873] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.938Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1092gitlab # [ 173.053752] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.941Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1093gitlab # [ 173.056550] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.943Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1094gitlab # [ 173.059090] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.946Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1095gitlab # [ 173.061726] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.950Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1096gitlab # [ 173.065316] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.953Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1097gitlab # [ 173.068936] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.957Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1098gitlab # [ 173.072528] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.960Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1099gitlab # [ 173.075814] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.964Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1100gitlab # [ 173.079293] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.967Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1101gitlab # [ 173.082459] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.970Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1102gitlab # [ 173.085139] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.973Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1103gitlab # [ 173.087658] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.975Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1104gitlab # [ 173.090333] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.978Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1105gitlab # [ 173.092924] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.981Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1106gitlab # [ 173.095418] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.983Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1107gitlab # [ 173.098946] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.986Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1108gitlab # [ 173.101300] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.988Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1109gitlab # [ 173.103686] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.991Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1110gitlab # [ 173.106188] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.993Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1111gitlab # [ 173.108644] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.995Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1112gitlab # [ 173.110913] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:04.997Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1113gitlab # [ 173.113395] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.000Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1114gitlab # [ 173.115807] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.002Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1115gitlab # [ 173.118213] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.005Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1116gitlab # [ 173.120465] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.007Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1117gitlab # [ 173.122617] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.010Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1118gitlab # [ 173.124819] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.013Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1119gitlab # [ 173.127019] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.015Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1120gitlab # [ 173.130061] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.018Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1121gitlab # [ 173.143876] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.032Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1122gitlab # [ 173.147208] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.035Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1123gitlab # [ 173.150236] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.038Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1124gitlab # [ 173.153055] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.041Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1125gitlab # [ 173.156063] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.044Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1126gitlab # [ 173.158837] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.047Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1127gitlab # [ 173.161299] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.049Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1128gitlab # [ 173.163700] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.051Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1129gitlab # [ 173.166019] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.054Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1130gitlab # [ 173.168213] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.056Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1131gitlab # [ 173.245527] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.133Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1132gitlab # [ 173.248677] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.137Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1133gitlab # [ 173.251340] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.139Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1134gitlab # [ 173.255524] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.143Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1135gitlab # [ 173.259486] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.145Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1136gitlab # [ 173.263565] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.149Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1137gitlab # [ 173.267836] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.150Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1138gitlab # [ 173.272238] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.152Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1139gitlab # [ 173.276284] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.155Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1140gitlab # [ 173.280245] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.157Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1141gitlab # [ 173.283979] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.161Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1142gitlab # [ 173.287759] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.163Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1143gitlab # [ 173.291601] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.165Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1144gitlab # [ 173.295228] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.168Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1145gitlab # [ 173.298513] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.170Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1146gitlab # [ 173.302002] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.173Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1147gitlab # [ 173.306123] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.175Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1148gitlab # [ 173.309007] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.177Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1149gitlab # [ 173.312086] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.179Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1150gitlab # [ 173.315207] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.182Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1151gitlab # [ 173.318363] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.185Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1152gitlab # [ 173.321333] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.187Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1153gitlab # [ 173.324435] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.190Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1154gitlab # [ 173.327333] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.193Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1155gitlab # [ 173.330553] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.196Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1156gitlab # [ 173.333517] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.198Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1157gitlab # [ 173.336445] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.200Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1158gitlab # [ 173.339192] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.203Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1159gitlab # [ 173.342089] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.205Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1160gitlab # [ 173.344797] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.207Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1161gitlab # [ 173.347420] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.209Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1162gitlab # [ 173.350308] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.211Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1163gitlab # [ 173.352602] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.215Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1164gitlab # [ 173.355153] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.217Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1165gitlab # [ 173.357755] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.221Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1166gitlab # [ 173.360179] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.223Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1167gitlab # [ 173.362498] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.239Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1168gitlab # [ 173.364843] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.241Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1169gitlab # [ 173.367050] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.243Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1170gitlab # [ 173.369423] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.247Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1171gitlab # [ 173.371455] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.250Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1172gitlab # [ 173.373745] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.253Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1173gitlab # [ 173.376080] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.256Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1174gitlab # [ 173.378380] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.258Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1175gitlab # [ 173.380500] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.260Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1176gitlab # [ 173.382710] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.264Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1177gitlab # [ 173.384994] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:05.266Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1178gitlab # [ 178.237797] gitlab-workhorse[825]: time="2026-08-20T08:19:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1179gitlab # [ 188.246344] gitlab-workhorse[825]: time="2026-08-20T08:19:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1180gitlab # [ 198.247423] gitlab-workhorse[825]: time="2026-08-20T08:19:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 208.254348] gitlab-workhorse[825]: time="2026-08-20T08:19:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 211.372106] postgres[2732]: [2732] ERROR: relation "table_without_models" does not exist1183gitlab # [ 211.372496] postgres[2732]: [2732] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1184gitlab # [ 217.306512] postgres[2779]: [2779] ERROR: relation "table_without_models" does not exist1185gitlab # [ 217.306870] postgres[2779]: [2779] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1186gitlab # [ 217.383664] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:49.269Z","message":"Booted Rails 7.2.3.1 application in production environment"}1187gitlab # [ 217.391033] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:49.270Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1188gitlab # [ 217.398343] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:49.270Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1189gitlab # [ 217.403845] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:49.270Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1190gitlab # [ 217.410229] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:49.280Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1191gitlab # [ 218.262311] gitlab-workhorse[825]: time="2026-08-20T08:19:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1192gitlab # [ 220.139429] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:52.026Z","message":"Cleaning working queues"}1193gitlab # [ 220.144432] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:52.029Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"db512137eb7628dbe54c03e8","created_at":"2026-08-20T08:18:12.510Z","trace_propagation_headers":{"sentry-trace":"e8f3f27d59914330af2e1675c5864669-defa2c06456a4097","baggage":"sentry-trace_id=e8f3f27d59914330af2e1675c5864669,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cc3dfc241c9f13c3a627a1c198169180","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:12.521Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-db512137eb7628dbe54c03e8: start","job_status":"start","queue_duration_s":99.508005,"scheduling_latency_s":99.508057}1194gitlab # [ 220.382134] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:19:52.269Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"db512137eb7628dbe54c03e8","created_at":"2026-08-20T08:18:12.510Z","trace_propagation_headers":{"sentry-trace":"e8f3f27d59914330af2e1675c5864669-defa2c06456a4097","baggage":"sentry-trace_id=e8f3f27d59914330af2e1675c5864669,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cc3dfc241c9f13c3a627a1c198169180","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:18:12.521Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-db512137eb7628dbe54c03e8: done: 0.240013 sec","job_status":"done","queue_duration_s":99.508005,"scheduling_latency_s":99.508057,"redis_calls":29,"redis_duration_s":0.009838,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.005347,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002785,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13278710000000002,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.240013,"completed_at":"2026-08-20T08:19:52.269Z","load_balancing_strategy":"primary","db_duration_s":0.072431,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1195gitlab # [ 224.153305] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.040Z","pid":1973,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1196gitlab # [ 224.158684] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.040Z","pid":1973,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1197gitlab # [ 224.158830] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.040Z","pid":1973,"message":"! #\u003cThread:0x0000f1bf6909de48 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1198gitlab # [ 224.166783] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.040Z","pid":1973,"message":"! #\u003cThread:0x0000f1bf6927b350 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1199gitlab # [ 224.173696] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.040Z","pid":1973,"message":"Use Ctrl-C to stop"}1200gitlab # [ 224.175048] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.041Z","pid":1973,"message":"Sending status to systemd every 1.0 sec"}1201gitlab # [ 224.749159] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.637Z","pid":1973,"message":"- Worker 0 (PID: 2897) booted in 0.53s, phase: 0"}1202gitlab # [ 224.835331] bundle[1973]: {"timestamp":"2026-08-20T08:19:56.723Z","pid":1973,"message":"- Worker 1 (PID: 2905) booted in 0.58s, phase: 0"}1203gitlab # [ 224.844146] systemd[1]: Started gitlab.service.1204gitlab # [ 224.844994] systemd[1]: Reached target Common target for all GitLab services..1205gitlab # [ 224.850262] systemd[1]: Starting setup-gitlab.service...1206gitlab # [ 224.879420] setup-gitlab-start[2934]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1207gitlab # [ 228.835317] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:20:00 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 39141208gitlab # [ 228.839982] setup-gitlab-start[2934]: + TOKEN=nixbot-test-token-of-20-chars1209gitlab # [ 228.844332] setup-gitlab-start[2934]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1210gitlab # [ 228.861166] runuser[2964]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1211gitlab # [ 229.430112] setup-gitlab-start[2965]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1212gitlab # [ 229.437068] setup-gitlab-start[2965]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1213gitlab # [ 229.443790] setup-gitlab-start[2965]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1214gitlab # [ 230.285870] setup-gitlab-start[2965]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1215gitlab # [ 230.286247] setup-gitlab-start[2965]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1216gitlab # [ 230.289010] setup-gitlab-start[2965]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1217gitlab # [ 233.573372] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:05.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ddfe8c54d647637393510bd6","created_at":"2026-08-20T08:20:05.358Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8a7cc6296a12e3b389a617439ad00c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.455Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ddfe8c54d647637393510bd6: start","job_status":"start","queue_duration_s":0.0038,"scheduling_latency_s":0.003867}1218gitlab # [ 234.047476] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:05.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ddfe8c54d647637393510bd6","created_at":"2026-08-20T08:20:05.358Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8a7cc6296a12e3b389a617439ad00c0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.455Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ddfe8c54d647637393510bd6: done: 0.474424 sec","job_status":"done","queue_duration_s":0.0038,"scheduling_latency_s":0.003867,"redis_calls":14,"redis_duration_s":0.022776,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00617,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.154923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00172158,"exclusive_lock_hold_duration_s":0.2658555,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.474424,"completed_at":"2026-08-20T08:20:05.933Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.063939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1219gitlab # [ 234.142966] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:05.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"31e7fb6242a5633042cdd65c","created_at":"2026-08-20T08:20:05.477Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d4fec88417b77cb2380aaa9375bdc4c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.493Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-31e7fb6242a5633042cdd65c: start","job_status":"start","queue_duration_s":0.452488,"scheduling_latency_s":0.452538}1220gitlab # [ 234.186777] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"31e7fb6242a5633042cdd65c","created_at":"2026-08-20T08:20:05.477Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d4fec88417b77cb2380aaa9375bdc4c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.493Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-31e7fb6242a5633042cdd65c: done: 0.127737 sec","job_status":"done","queue_duration_s":0.452488,"scheduling_latency_s":0.452538,"redis_calls":12,"redis_duration_s":0.03882,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003172,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.027973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007675,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00186954,"exclusive_lock_hold_duration_s":0.013340020000000001,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.127737,"completed_at":"2026-08-20T08:20:06.073Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1221gitlab # [ 234.271539] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"42b57b0cf282d94b5f27cfd0","created_at":"2026-08-20T08:20:05.506Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abc70cad001a427b966bad2812fbe868","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.528Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-42b57b0cf282d94b5f27cfd0: start","job_status":"start","queue_duration_s":0.558825,"scheduling_latency_s":0.558879}1222gitlab # [ 234.379668] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"42b57b0cf282d94b5f27cfd0","created_at":"2026-08-20T08:20:05.506Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abc70cad001a427b966bad2812fbe868","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.528Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-42b57b0cf282d94b5f27cfd0: done: 0.179097 sec","job_status":"done","queue_duration_s":0.558825,"scheduling_latency_s":0.558879,"redis_calls":10,"redis_duration_s":0.019697,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00222,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015823,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00179346,"duration_s":0.179097,"completed_at":"2026-08-20T08:20:06.265Z","load_balancing_strategy":"primary","db_duration_s":0.074681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1223gitlab # [ 234.463354] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"2578424a86bd4aa52a899862","created_at":"2026-08-20T08:20:05.548Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b098077401f1eec2273aa9139c943f8","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.560Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-2578424a86bd4aa52a899862: start","job_status":"start","queue_duration_s":0.716772,"scheduling_latency_s":0.716821}1224gitlab # [ 234.539895] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"2578424a86bd4aa52a899862","created_at":"2026-08-20T08:20:05.548Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b098077401f1eec2273aa9139c943f8","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.560Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-2578424a86bd4aa52a899862: done: 0.150031 sec","job_status":"done","queue_duration_s":0.716772,"scheduling_latency_s":0.716821,"redis_calls":10,"redis_duration_s":0.018099,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002533,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010425,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005141,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001721,"duration_s":0.150031,"completed_at":"2026-08-20T08:20:06.427Z","load_balancing_strategy":"primary","db_duration_s":0.054008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 234.633222] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f38a9d51385ee44e7272999e","created_at":"2026-08-20T08:20:05.584Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d285e12f99b979528cc97f82a3d84979","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.617Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f38a9d51385ee44e7272999e: start","job_status":"start","queue_duration_s":0.817072,"scheduling_latency_s":0.817124}1226gitlab # [ 234.664532] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f38a9d51385ee44e7272999e","created_at":"2026-08-20T08:20:05.584Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d285e12f99b979528cc97f82a3d84979","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.617Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f38a9d51385ee44e7272999e: done: 0.116204 sec","job_status":"done","queue_duration_s":0.817072,"scheduling_latency_s":0.817124,"redis_calls":12,"redis_duration_s":0.023023000000000002,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004481,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013969,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004573,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00273086,"duration_s":0.116204,"completed_at":"2026-08-20T08:20:06.550Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 234.725901] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"adb333e730445d7e748fec9f","created_at":"2026-08-20T08:20:05.692Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae4bfadb87ac8004703b490a6b21f2e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.705Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-adb333e730445d7e748fec9f: start","job_status":"start","queue_duration_s":0.865901,"scheduling_latency_s":0.865948}1228gitlab # [ 234.799289] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"adb333e730445d7e748fec9f","created_at":"2026-08-20T08:20:05.692Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae4bfadb87ac8004703b490a6b21f2e7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.705Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-adb333e730445d7e748fec9f: done: 0.114814 sec","job_status":"done","queue_duration_s":0.865901,"scheduling_latency_s":0.865948,"redis_calls":10,"redis_duration_s":0.039105,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.028246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006436,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01610476,"duration_s":0.114814,"completed_at":"2026-08-20T08:20:06.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 234.868076] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"46fa7783bc15711ef4ca6c3f","created_at":"2026-08-20T08:20:05.714Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c36ed09deb26720d839c0fe2adc41e7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.727Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-46fa7783bc15711ef4ca6c3f: start","job_status":"start","queue_duration_s":0.993897,"scheduling_latency_s":0.993943}1230gitlab # [ 235.061014] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"46fa7783bc15711ef4ca6c3f","created_at":"2026-08-20T08:20:05.714Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0c36ed09deb26720d839c0fe2adc41e7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.727Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-46fa7783bc15711ef4ca6c3f: done: 0.226401 sec","job_status":"done","queue_duration_s":0.993897,"scheduling_latency_s":0.993943,"redis_calls":17,"redis_duration_s":0.044107999999999994,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.020585,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.004984,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00414476,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.226401,"completed_at":"2026-08-20T08:20:06.948Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 235.154579] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:06.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"48d03e7470fa830d6451ea66","created_at":"2026-08-20T08:20:05.751Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9019b2fc5913fbae830154207ed5863","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.761Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-48d03e7470fa830d6451ea66: start","job_status":"start","queue_duration_s":1.2013,"scheduling_latency_s":1.20135}1232gitlab # [ 235.171816] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.010Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1233gitlab # [ 235.175568] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"48d03e7470fa830d6451ea66","created_at":"2026-08-20T08:20:05.751Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9019b2fc5913fbae830154207ed5863","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.761Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-48d03e7470fa830d6451ea66: done: 0.069819 sec","job_status":"done","queue_duration_s":1.2013,"scheduling_latency_s":1.20135,"redis_calls":10,"redis_duration_s":0.018532,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001079,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003132,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074616,"duration_s":0.069819,"completed_at":"2026-08-20T08:20:07.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00104,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 235.220641] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.036Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b4d1f32d511b101f279af26f","created_at":"2026-08-20T08:20:05.768Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7eb6145fea46ce1a1d836e1f9904f24e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:20:05.777Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b4d1f32d511b101f279af26f: start","job_status":"start","queue_duration_s":1.258938,"scheduling_latency_s":1.258975}1235gitlab # [ 235.234041] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"b4d1f32d511b101f279af26f","created_at":"2026-08-20T08:20:05.768Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7eb6145fea46ce1a1d836e1f9904f24e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:20:05.777Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-b4d1f32d511b101f279af26f: done: 0.074794 sec","job_status":"done","queue_duration_s":1.258938,"scheduling_latency_s":1.258975,"redis_calls":10,"redis_duration_s":0.004269,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000961,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00087338,"duration_s":0.074794,"completed_at":"2026-08-20T08:20:07.110Z","load_balancing_strategy":"primary","db_duration_s":0.009416,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 235.275109] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.114Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"761341ef25fb0fae59a71471","created_at":"2026-08-20T08:20:05.802Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfca1fe9cd083825dfe52f802e4fed54","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.809Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-761341ef25fb0fae59a71471: start","job_status":"start","queue_duration_s":1.305026,"scheduling_latency_s":1.305059}1237gitlab # [ 235.316381] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"761341ef25fb0fae59a71471","created_at":"2026-08-20T08:20:05.802Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfca1fe9cd083825dfe52f802e4fed54","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.809Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-761341ef25fb0fae59a71471: done: 0.089081 sec","job_status":"done","queue_duration_s":1.305026,"scheduling_latency_s":1.305059,"redis_calls":10,"redis_duration_s":0.0037979999999999997,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002384,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00088076,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00657324},"duration_s":0.089081,"completed_at":"2026-08-20T08:20:07.203Z","load_balancing_strategy":"primary","db_duration_s":0.028917,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 235.361250] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2731303bf4a92a44cb3e7b77","created_at":"2026-08-20T08:20:05.823Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3663cd70fe056d841637fc9cd88fad30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.837Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2731303bf4a92a44cb3e7b77: start","job_status":"start","queue_duration_s":1.369597,"scheduling_latency_s":1.36963}1239gitlab # [ 235.418008] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.305Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2731303bf4a92a44cb3e7b77","created_at":"2026-08-20T08:20:05.823Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3663cd70fe056d841637fc9cd88fad30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.837Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2731303bf4a92a44cb3e7b77: done: 0.09796 sec","job_status":"done","queue_duration_s":1.369597,"scheduling_latency_s":1.36963,"redis_calls":12,"redis_duration_s":0.005533000000000001,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000738,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002344,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00129598,"exclusive_lock_hold_duration_s":0.03254736,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.09796,"completed_at":"2026-08-20T08:20:07.304Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 235.475193] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bb4f3fa750ab32e774cfc596","created_at":"2026-08-20T08:20:05.842Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e0392ca81d1e7d3da4dcfb10da5c23","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.858Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bb4f3fa750ab32e774cfc596: start","job_status":"start","queue_duration_s":1.450208,"scheduling_latency_s":1.450238}1241gitlab # [ 235.490095] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bb4f3fa750ab32e774cfc596","created_at":"2026-08-20T08:20:05.842Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e0392ca81d1e7d3da4dcfb10da5c23","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.858Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bb4f3fa750ab32e774cfc596: done: 0.055155 sec","job_status":"done","queue_duration_s":1.450208,"scheduling_latency_s":1.450238,"redis_calls":13,"redis_duration_s":0.00463,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000659,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002516,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001455,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.017122500000000002,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.055155,"completed_at":"2026-08-20T08:20:07.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004907,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1242gitlab # [ 235.534582] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.366Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"50a80562dad939e4a801b50f","created_at":"2026-08-20T08:20:05.881Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"50e86f9e9fcb5b54015110b8c3865cdf","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.897Z","job_size_bytes":3,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-50a80562dad939e4a801b50f: start","job_status":"start","queue_duration_s":1.46823,"scheduling_latency_s":1.468255}1243gitlab # [ 235.548627] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.394Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"50a80562dad939e4a801b50f","created_at":"2026-08-20T08:20:05.881Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"50e86f9e9fcb5b54015110b8c3865cdf","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.897Z","job_size_bytes":3,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-50a80562dad939e4a801b50f: done: 0.02836 sec","job_status":"done","queue_duration_s":1.46823,"scheduling_latency_s":1.468255,"redis_calls":10,"redis_duration_s":0.002888,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000591,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001724,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004341,"duration_s":0.02836,"completed_at":"2026-08-20T08:20:07.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000688,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 235.590432] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b51ed4b4781548e914ac5ebf","created_at":"2026-08-20T08:20:05.925Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"870a103fbc865223ef188e020f4749b7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.943Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b51ed4b4781548e914ac5ebf: start","job_status":"start","queue_duration_s":1.452564,"scheduling_latency_s":1.452583}1245gitlab # [ 235.605461] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b51ed4b4781548e914ac5ebf","created_at":"2026-08-20T08:20:05.925Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"870a103fbc865223ef188e020f4749b7","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:05.943Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b51ed4b4781548e914ac5ebf: done: 0.061967 sec","job_status":"done","queue_duration_s":1.452564,"scheduling_latency_s":1.452583,"redis_calls":10,"redis_duration_s":0.003191,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000699,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00100514,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.061967,"completed_at":"2026-08-20T08:20:07.458Z","load_balancing_strategy":"primary","db_duration_s":0.030438,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 235.647854] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"205bf267c485142e3a36985f","created_at":"2026-08-20T08:20:05.990Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33f2b5af916a4236b1d8f2ce4ae1a979","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.026Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-205bf267c485142e3a36985f: start","job_status":"start","queue_duration_s":1.434211,"scheduling_latency_s":1.434237}1247gitlab # [ 235.662709] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.479Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1248gitlab # [ 235.666001] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"205bf267c485142e3a36985f","created_at":"2026-08-20T08:20:05.990Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33f2b5af916a4236b1d8f2ce4ae1a979","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.026Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-205bf267c485142e3a36985f: done: 0.029284 sec","job_status":"done","queue_duration_s":1.434211,"scheduling_latency_s":1.434237,"redis_calls":10,"redis_duration_s":0.002949,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000606,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042466,"duration_s":0.029284,"completed_at":"2026-08-20T08:20:07.490Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 235.708086] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d6a202c97a17be33209e6803","created_at":"2026-08-20T08:20:06.064Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.085Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d6a202c97a17be33209e6803: start","job_status":"start","queue_duration_s":1.406986,"scheduling_latency_s":1.407009}1250gitlab # [ 235.721399] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d6a202c97a17be33209e6803","created_at":"2026-08-20T08:20:06.064Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.085Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d6a202c97a17be33209e6803: done: 0.048207 sec","job_status":"done","queue_duration_s":1.406986,"scheduling_latency_s":1.407009,"redis_calls":19,"redis_duration_s":0.0052109999999999995,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001191,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000551,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002606,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037138,"duration_s":0.048207,"completed_at":"2026-08-20T08:20:07.540Z","load_balancing_strategy":"primary","db_duration_s":0.0034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 235.764174] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bb03c7e1f7ddf9feaaabcf8d","created_at":"2026-08-20T08:20:06.101Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db4e107c887270c35c73b6564d355379","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.137Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bb03c7e1f7ddf9feaaabcf8d: start","job_status":"start","queue_duration_s":1.404884,"scheduling_latency_s":1.4049}1252gitlab # [ 235.778301] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bb03c7e1f7ddf9feaaabcf8d","created_at":"2026-08-20T08:20:06.101Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db4e107c887270c35c73b6564d355379","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.137Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bb03c7e1f7ddf9feaaabcf8d: done: 0.028261 sec","job_status":"done","queue_duration_s":1.404884,"scheduling_latency_s":1.4049,"redis_calls":12,"redis_duration_s":0.0032310000000000004,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060374,"exclusive_lock_hold_duration_s":0.00712152,"duration_s":0.028261,"completed_at":"2026-08-20T08:20:07.570Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 235.822052] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b35e9e58c75d72fce546d682","created_at":"2026-08-20T08:20:06.198Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab48a761433cc3fba95f126e2c1f8518","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.225Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b35e9e58c75d72fce546d682: start","job_status":"start","queue_duration_s":1.346836,"scheduling_latency_s":1.34685}1254gitlab # [ 235.835485] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b35e9e58c75d72fce546d682","created_at":"2026-08-20T08:20:06.198Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab48a761433cc3fba95f126e2c1f8518","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.225Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b35e9e58c75d72fce546d682: done: 0.021931 sec","job_status":"done","queue_duration_s":1.346836,"scheduling_latency_s":1.34685,"redis_calls":12,"redis_duration_s":0.003381,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00056,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000565,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034526,"duration_s":0.021931,"completed_at":"2026-08-20T08:20:07.593Z","load_balancing_strategy":"primary","db_duration_s":0.000638,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 235.878575] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1bda5141d121e9e31c054c40","created_at":"2026-08-20T08:20:06.254Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6cb0c33f0be506a23e0acd43f605f67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.273Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1bda5141d121e9e31c054c40: start","job_status":"start","queue_duration_s":1.32153,"scheduling_latency_s":1.321545}1256gitlab # [ 235.893099] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.607Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1257gitlab # [ 235.896858] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1bda5141d121e9e31c054c40","created_at":"2026-08-20T08:20:06.254Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6cb0c33f0be506a23e0acd43f605f67","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.273Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1bda5141d121e9e31c054c40: done: 0.019653 sec","job_status":"done","queue_duration_s":1.32153,"scheduling_latency_s":1.321545,"redis_calls":10,"redis_duration_s":0.002524,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033688,"duration_s":0.019653,"completed_at":"2026-08-20T08:20:07.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 235.939732] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::CleanupPackageRegistryWorker","jid":"e1dde09ac9c53c7ecfb7a048","created_at":"2026-08-20T08:20:06.306Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c02bc2657b370304ec528393cbe41309","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31163b2078644913f89feb2245c5fa62ac9118d29e04cf14ce0b5def57bba8ea","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.339Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::CleanupPackageRegistryWorker JID-e1dde09ac9c53c7ecfb7a048: start","job_status":"start","queue_duration_s":1.276939,"scheduling_latency_s":1.276955}1259gitlab # [ 235.953951] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::CleanupPackageRegistryWorker","jid":"e1dde09ac9c53c7ecfb7a048","created_at":"2026-08-20T08:20:06.306Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c02bc2657b370304ec528393cbe41309","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31163b2078644913f89feb2245c5fa62ac9118d29e04cf14ce0b5def57bba8ea","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.339Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::CleanupPackageRegistryWorker JID-e1dde09ac9c53c7ecfb7a048: done: 0.08382 sec","job_status":"done","queue_duration_s":1.276939,"scheduling_latency_s":1.276955,"redis_calls":10,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":9,"redis_write_bytes":1125,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000507,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000537,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":10,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051202,"extra.packages_cleanup_package_registry_worker.pending_destruction_package_files_count":0,"extra.packages_cleanup_package_registry_worker.processing_package_files_count":0,"extra.packages_cleanup_package_registry_worker.error_package_files_count":0,"extra.packages_cleanup_package_registry_worker.pending_cleanup_policies_count":0,"duration_s":0.08382,"completed_at":"2026-08-20T08:20:07.700Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 236.000111] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"d784bbc42b0fcbf8af154c6c","created_at":"2026-08-20T08:20:06.350Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8adaceca6795f26e108a0420136af146","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.370Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-d784bbc42b0fcbf8af154c6c: start","job_status":"start","queue_duration_s":1.332418,"scheduling_latency_s":1.33244}1261gitlab # [ 236.015225] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"d784bbc42b0fcbf8af154c6c","created_at":"2026-08-20T08:20:06.350Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8adaceca6795f26e108a0420136af146","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.370Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-d784bbc42b0fcbf8af154c6c: done: 0.045957 sec","job_status":"done","queue_duration_s":1.332418,"scheduling_latency_s":1.33244,"redis_calls":20,"redis_duration_s":0.003705,"redis_read_bytes":23,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001278,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000623,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002503,"duration_s":0.045957,"completed_at":"2026-08-20T08:20:07.748Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 236.059051] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.749Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"3cce7cab90d6cf04d2d5f2f7","created_at":"2026-08-20T08:20:06.391Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f099ff95da3b715605a37bf5f13b388","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.421Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-3cce7cab90d6cf04d2d5f2f7: start","job_status":"start","queue_duration_s":1.327652,"scheduling_latency_s":1.327669}1263gitlab # [ 236.072165] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"3cce7cab90d6cf04d2d5f2f7","created_at":"2026-08-20T08:20:06.391Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f099ff95da3b715605a37bf5f13b388","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.421Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-3cce7cab90d6cf04d2d5f2f7: done: 0.045094 sec","job_status":"done","queue_duration_s":1.327652,"scheduling_latency_s":1.327669,"redis_calls":10,"redis_duration_s":0.0017130000000000001,"redis_read_bytes":9,"redis_write_bytes":1039,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022826,"duration_s":0.045094,"completed_at":"2026-08-20T08:20:07.794Z","load_balancing_strategy":"primary","db_duration_s":0.012245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 236.113380] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3ec82a50705a1fbffcbdf4ab","created_at":"2026-08-20T08:20:06.444Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58a5d33c0a7bb9d9adac9402f93332c9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:20:06.476Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3ec82a50705a1fbffcbdf4ab: start","job_status":"start","queue_duration_s":1.319262,"scheduling_latency_s":1.319279}1265gitlab # [ 236.126742] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.807Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1266gitlab # [ 236.130013] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3ec82a50705a1fbffcbdf4ab","created_at":"2026-08-20T08:20:06.444Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58a5d33c0a7bb9d9adac9402f93332c9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:20:06.476Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3ec82a50705a1fbffcbdf4ab: done: 0.018294 sec","job_status":"done","queue_duration_s":1.319262,"scheduling_latency_s":1.319279,"redis_calls":10,"redis_duration_s":0.00133,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002309,"duration_s":0.018294,"completed_at":"2026-08-20T08:20:07.814Z","load_balancing_strategy":"primary","db_duration_s":0.000333,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 236.171572] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dbc42297dc0d5641f8530119","created_at":"2026-08-20T08:20:06.497Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fd9f7f3a685a67234beb5ded2a44542","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.545Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dbc42297dc0d5641f8530119: start","job_status":"start","queue_duration_s":1.270597,"scheduling_latency_s":1.270614}1268gitlab # [ 236.185749] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"dbc42297dc0d5641f8530119","created_at":"2026-08-20T08:20:06.497Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fd9f7f3a685a67234beb5ded2a44542","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.545Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-dbc42297dc0d5641f8530119: done: 0.02475 sec","job_status":"done","queue_duration_s":1.270597,"scheduling_latency_s":1.270614,"redis_calls":12,"redis_duration_s":0.001671,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000656,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048052,"exclusive_lock_hold_duration_s":0.0060902000000000005,"duration_s":0.02475,"completed_at":"2026-08-20T08:20:07.840Z","load_balancing_strategy":"primary","db_duration_s":0.002362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 236.228816] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryCheck::DispatchWorker","jid":"a5743dab632847f0b7ad883e","created_at":"2026-08-20T08:20:06.573Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b15820348b68b017029bc32e1569c68","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:bce0277309dfde25386eb0f6b49415f8ec269d6e1b0147ad102f2a38c86bd6e2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.589Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::DispatchWorker JID-a5743dab632847f0b7ad883e: start","job_status":"start","queue_duration_s":1.251853,"scheduling_latency_s":1.251868}1270gitlab # [ 236.242323] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryCheck::DispatchWorker","jid":"a5743dab632847f0b7ad883e","created_at":"2026-08-20T08:20:06.573Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6b15820348b68b017029bc32e1569c68","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:bce0277309dfde25386eb0f6b49415f8ec269d6e1b0147ad102f2a38c86bd6e2","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.589Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::DispatchWorker JID-a5743dab632847f0b7ad883e: done: 0.044261 sec","job_status":"done","queue_duration_s":1.251853,"scheduling_latency_s":1.251868,"gitaly_calls":1,"gitaly_duration_s":0.011871,"redis_calls":26,"redis_duration_s":0.004106,"redis_read_bytes":45,"redis_write_bytes":3470,"redis_cache_calls":5,"redis_cache_duration_s":0.001045,"redis_cache_read_bytes":23,"redis_cache_write_bytes":95,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001294,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1190,"redis_queues_calls":2,"redis_queues_duration_s":0.000203,"redis_queues_read_bytes":3,"redis_queues_write_bytes":918,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":758,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":509,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02214386,"duration_s":0.044261,"completed_at":"2026-08-20T08:20:07.885Z","load_balancing_strategy":"primary","db_duration_s":0.001204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 236.286817] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9140176cf53ee029ff236e4e","created_at":"2026-08-20T08:20:06.624Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30958e62671c21e94928c070e0501c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.657Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9140176cf53ee029ff236e4e: start","job_status":"start","queue_duration_s":1.22951,"scheduling_latency_s":1.229526}1272gitlab # [ 236.301076] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9140176cf53ee029ff236e4e","created_at":"2026-08-20T08:20:06.624Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30958e62671c21e94928c070e0501c1f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.657Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9140176cf53ee029ff236e4e: done: 0.023071 sec","job_status":"done","queue_duration_s":1.22951,"scheduling_latency_s":1.229526,"redis_calls":10,"redis_duration_s":0.001392,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022936,"duration_s":0.023071,"completed_at":"2026-08-20T08:20:07.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 236.343342] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:07.911Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"27859a7fa34bef2f60f0c560","created_at":"2026-08-20T08:20:06.669Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fa074f73f66514e1bd12af7107e20d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.692Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-27859a7fa34bef2f60f0c560: start","job_status":"start","queue_duration_s":1.219007,"scheduling_latency_s":1.219023}1274gitlab # [ 236.357669] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"27859a7fa34bef2f60f0c560","created_at":"2026-08-20T08:20:06.669Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fa074f73f66514e1bd12af7107e20d8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.692Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-27859a7fa34bef2f60f0c560: done: 0.332724 sec","job_status":"done","queue_duration_s":1.219007,"scheduling_latency_s":1.219023,"redis_calls":14,"redis_duration_s":0.002725,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000565,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001111,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001049,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.273249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000471,"exclusive_lock_hold_duration_s":0.31003758,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.332724,"completed_at":"2026-08-20T08:20:08.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 236.402625] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.245Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f1b6a9a1eba769f224341d35","created_at":"2026-08-20T08:20:06.700Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d00814c574fb12dcb087bd08e1fa7d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.712Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f1b6a9a1eba769f224341d35: start","job_status":"start","queue_duration_s":1.533102,"scheduling_latency_s":1.53312}1276gitlab # [ 236.472497] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.360Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1277gitlab # [ 236.480698] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.368Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f1b6a9a1eba769f224341d35","created_at":"2026-08-20T08:20:06.700Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d00814c574fb12dcb087bd08e1fa7d0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.712Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f1b6a9a1eba769f224341d35: done: 0.123136 sec","job_status":"done","queue_duration_s":1.533102,"scheduling_latency_s":1.53312,"redis_calls":10,"redis_duration_s":0.0032589999999999997,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001233,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000529,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037836,"duration_s":0.123136,"completed_at":"2026-08-20T08:20:08.368Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 236.541756] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.370Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e79682c3a8f61d004c0c97ab","created_at":"2026-08-20T08:20:06.720Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.734Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e79682c3a8f61d004c0c97ab: start","job_status":"start","queue_duration_s":1.636616,"scheduling_latency_s":1.636635}1279gitlab # [ 236.605778] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e79682c3a8f61d004c0c97ab","created_at":"2026-08-20T08:20:06.720Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.734Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e79682c3a8f61d004c0c97ab: done: 0.123186 sec","job_status":"done","queue_duration_s":1.636616,"scheduling_latency_s":1.636635,"redis_calls":71,"redis_duration_s":0.020753,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002733,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001275,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015975,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00077,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000378,"duration_s":0.123186,"completed_at":"2026-08-20T08:20:08.493Z","load_balancing_strategy":"primary","db_duration_s":0.003128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 236.678375] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.495Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"fdc5e3fc55ca176be8b86fae","created_at":"2026-08-20T08:20:06.765Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a85c93acfa87d16b9ae03af24c37195","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.772Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-fdc5e3fc55ca176be8b86fae: start","job_status":"start","queue_duration_s":1.722689,"scheduling_latency_s":1.722707}1281gitlab # [ 236.693621] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.519Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"fdc5e3fc55ca176be8b86fae","created_at":"2026-08-20T08:20:06.765Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a85c93acfa87d16b9ae03af24c37195","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.772Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-fdc5e3fc55ca176be8b86fae: done: 0.023948 sec","job_status":"done","queue_duration_s":1.722689,"scheduling_latency_s":1.722707,"redis_calls":10,"redis_duration_s":0.002486,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000534,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003481,"duration_s":0.023948,"completed_at":"2026-08-20T08:20:08.519Z","load_balancing_strategy":"primary","db_duration_s":0.001232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 236.736355] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.520Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e559acfd91d94747ab3f4060","created_at":"2026-08-20T08:20:06.776Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d30b4d3f5f6d2ff9724d6e12aae2bea8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.784Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e559acfd91d94747ab3f4060: start","job_status":"start","queue_duration_s":1.736184,"scheduling_latency_s":1.736201}1283gitlab # [ 236.751092] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.550Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e559acfd91d94747ab3f4060","created_at":"2026-08-20T08:20:06.776Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d30b4d3f5f6d2ff9724d6e12aae2bea8","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.784Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e559acfd91d94747ab3f4060: done: 0.029193 sec","job_status":"done","queue_duration_s":1.736184,"scheduling_latency_s":1.736201,"redis_calls":10,"redis_duration_s":0.002784,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038912,"duration_s":0.029193,"completed_at":"2026-08-20T08:20:08.550Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 236.793945] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"cf20c84e75613d37e85dddc3","created_at":"2026-08-20T08:20:06.788Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ae6547d4c65535b00c55e1c3bbae529","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.795Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-cf20c84e75613d37e85dddc3: start","job_status":"start","queue_duration_s":1.756102,"scheduling_latency_s":1.756118}1285gitlab # [ 236.808135] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"cf20c84e75613d37e85dddc3","created_at":"2026-08-20T08:20:06.788Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7ae6547d4c65535b00c55e1c3bbae529","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.795Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-cf20c84e75613d37e85dddc3: done: 0.023912 sec","job_status":"done","queue_duration_s":1.756102,"scheduling_latency_s":1.756118,"redis_calls":10,"redis_duration_s":0.002471,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000545,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037404,"duration_s":0.023912,"completed_at":"2026-08-20T08:20:08.575Z","load_balancing_strategy":"primary","db_duration_s":0.000713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 236.851026] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a72051ba45ab55f97e52957c","created_at":"2026-08-20T08:20:06.812Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99f1b65a3320fccf26e34b2ebb4f2b3b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:20:06.835Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a72051ba45ab55f97e52957c: start","job_status":"start","queue_duration_s":1.741167,"scheduling_latency_s":1.741182}1287gitlab # [ 236.864680] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.589Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1288gitlab # [ 236.868307] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a72051ba45ab55f97e52957c","created_at":"2026-08-20T08:20:06.812Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99f1b65a3320fccf26e34b2ebb4f2b3b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:20:06.835Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a72051ba45ab55f97e52957c: done: 0.019991 sec","job_status":"done","queue_duration_s":1.741167,"scheduling_latency_s":1.741182,"redis_calls":10,"redis_duration_s":0.002623,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000615,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00054,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034362,"duration_s":0.019991,"completed_at":"2026-08-20T08:20:08.596Z","load_balancing_strategy":"primary","db_duration_s":0.000612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 236.910104] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7fdd0787a7f48dafcaa6c2a2","created_at":"2026-08-20T08:20:06.864Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2598e439fe093cddff5e7d13890f5d6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.882Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7fdd0787a7f48dafcaa6c2a2: start","job_status":"start","queue_duration_s":1.715682,"scheduling_latency_s":1.715697}1290gitlab # [ 237.089459] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7fdd0787a7f48dafcaa6c2a2","created_at":"2026-08-20T08:20:06.864Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2598e439fe093cddff5e7d13890f5d6","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.882Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7fdd0787a7f48dafcaa6c2a2: done: 0.378837 sec","job_status":"done","queue_duration_s":1.715682,"scheduling_latency_s":1.715697,"redis_calls":565,"redis_duration_s":0.08494600000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.08308,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.332734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033858,"duration_s":0.378837,"completed_at":"2026-08-20T08:20:08.977Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 237.184357] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:08.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7f68e13bc6850c8765ba1065","created_at":"2026-08-20T08:20:06.904Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0c06fec02fba11c3b4658f00fb84a50","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.924Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7f68e13bc6850c8765ba1065: start","job_status":"start","queue_duration_s":2.054222,"scheduling_latency_s":2.054242}1292gitlab # [ 237.202450] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7f68e13bc6850c8765ba1065","created_at":"2026-08-20T08:20:06.904Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b0c06fec02fba11c3b4658f00fb84a50","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.924Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7f68e13bc6850c8765ba1065: done: 0.031333 sec","job_status":"done","queue_duration_s":2.054222,"scheduling_latency_s":2.054242,"redis_calls":10,"redis_duration_s":0.00266,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001569,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039574,"duration_s":0.031333,"completed_at":"2026-08-20T08:20:09.010Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 237.246364] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"5aae571acf28e09d14d2e9fc","created_at":"2026-08-20T08:20:06.944Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30af504df94e9769d310aba2d634432e","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.984Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-5aae571acf28e09d14d2e9fc: start","job_status":"start","queue_duration_s":2.027432,"scheduling_latency_s":2.027449}1294gitlab # [ 237.262409] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"5aae571acf28e09d14d2e9fc","created_at":"2026-08-20T08:20:06.944Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30af504df94e9769d310aba2d634432e","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:06.984Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-5aae571acf28e09d14d2e9fc: done: 0.02949 sec","job_status":"done","queue_duration_s":2.027432,"scheduling_latency_s":2.027449,"redis_calls":13,"redis_duration_s":0.003458,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001448,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001431,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036682,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.02949,"completed_at":"2026-08-20T08:20:09.041Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 237.307887] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.042Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"be432bf0d71084332feb7a00","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-be432bf0d71084332feb7a00: start","job_status":"start","queue_duration_s":1.51161,"scheduling_latency_s":1.511626}1296gitlab # [ 237.320692] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.060Z","message":"No existing merge request to be cleaned up."}1297gitlab # [ 237.322347] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.076Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"be432bf0d71084332feb7a00","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-be432bf0d71084332feb7a00: done: 0.033979 sec","job_status":"done","queue_duration_s":1.51161,"scheduling_latency_s":1.511626,"redis_calls":13,"redis_duration_s":0.0037819999999999998,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001357,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036864,"duration_s":0.033979,"completed_at":"2026-08-20T08:20:09.076Z","load_balancing_strategy":"primary","db_duration_s":0.005785,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 237.362893] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.078Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fbd4a60fbad6b75b20a7a180","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fbd4a60fbad6b75b20a7a180: start","job_status":"start","queue_duration_s":1.547194,"scheduling_latency_s":1.547212}1299gitlab # [ 237.375622] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.090Z","message":"No existing merge request to be cleaned up."}1300gitlab # [ 237.377479] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.099Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fbd4a60fbad6b75b20a7a180","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fbd4a60fbad6b75b20a7a180: done: 0.021124 sec","job_status":"done","queue_duration_s":1.547194,"scheduling_latency_s":1.547212,"redis_calls":10,"redis_duration_s":0.0025970000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00152,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021124,"completed_at":"2026-08-20T08:20:09.099Z","load_balancing_strategy":"primary","db_duration_s":0.002709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 237.416117] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.101Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"235ecba43c1293c351163770","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-235ecba43c1293c351163770: start","job_status":"start","queue_duration_s":1.570346,"scheduling_latency_s":1.570364}1302gitlab # [ 237.428455] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.112Z","message":"No existing merge request to be cleaned up."}1303gitlab # [ 237.430112] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.122Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"235ecba43c1293c351163770","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-235ecba43c1293c351163770: done: 0.02074 sec","job_status":"done","queue_duration_s":1.570346,"scheduling_latency_s":1.570364,"redis_calls":10,"redis_duration_s":0.002677,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00152,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02074,"completed_at":"2026-08-20T08:20:09.122Z","load_balancing_strategy":"primary","db_duration_s":0.002581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 237.470037] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.123Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9e03ae2697680a7cdd4f4206","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9e03ae2697680a7cdd4f4206: start","job_status":"start","queue_duration_s":1.592614,"scheduling_latency_s":1.592629}1305gitlab # [ 237.482370] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.135Z","message":"No existing merge request to be cleaned up."}1306gitlab # [ 237.484050] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.143Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9e03ae2697680a7cdd4f4206","created_at":"2026-08-20T08:20:07.514Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-a8eb13ee107d4780","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b16913aebee569861d289f12e4cf7f30","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.531Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9e03ae2697680a7cdd4f4206: done: 0.019921 sec","job_status":"done","queue_duration_s":1.592614,"scheduling_latency_s":1.592629,"redis_calls":10,"redis_duration_s":0.002628,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00155,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019921,"completed_at":"2026-08-20T08:20:09.143Z","load_balancing_strategy":"primary","db_duration_s":0.002489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 237.523131] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.145Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"edefe96159f29b3c57266f14","created_at":"2026-08-20T08:20:07.724Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-3b6700d3dd2848ee","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8adaceca6795f26e108a0420136af146","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.734Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-edefe96159f29b3c57266f14: start","job_status":"start","queue_duration_s":1.410966,"scheduling_latency_s":1.410982}1308gitlab # [ 237.538378] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.170Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"edefe96159f29b3c57266f14","created_at":"2026-08-20T08:20:07.724Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-3b6700d3dd2848ee","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8adaceca6795f26e108a0420136af146","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.734Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-edefe96159f29b3c57266f14: done: 0.02556 sec","job_status":"done","queue_duration_s":1.410966,"scheduling_latency_s":1.410982,"redis_calls":10,"redis_duration_s":0.002577,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003473,"duration_s":0.02556,"completed_at":"2026-08-20T08:20:09.170Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 237.581666] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.172Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"526faabdb7dec0d328fe6602","created_at":"2026-08-20T08:20:07.735Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-3b6700d3dd2848ee","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8adaceca6795f26e108a0420136af146","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.740Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-526faabdb7dec0d328fe6602: start","job_status":"start","queue_duration_s":1.432139,"scheduling_latency_s":1.432154}1310gitlab # [ 237.596852] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.194Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"526faabdb7dec0d328fe6602","created_at":"2026-08-20T08:20:07.735Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-3b6700d3dd2848ee","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8adaceca6795f26e108a0420136af146","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.740Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-526faabdb7dec0d328fe6602: done: 0.022178 sec","job_status":"done","queue_duration_s":1.432139,"scheduling_latency_s":1.432154,"redis_calls":10,"redis_duration_s":0.002577,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035346,"duration_s":0.022178,"completed_at":"2026-08-20T08:20:09.194Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 237.640279] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.196Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"repository_check","args":["default"],"class":"RepositoryCheck::BatchWorker","jid":"fe0f86aa0b6ce4f17a17e9ab","created_at":"2026-08-20T08:20:07.874Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cbedbd6bda814aff","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"RepositoryCheck::DispatchWorker","correlation_id":"6b15820348b68b017029bc32e1569c68","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b22e99a0acd71e0cf2962b3ba955d6f34621628300baf74d4c861b087bc17605","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.878Z","job_size_bytes":11,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::BatchWorker JID-fe0f86aa0b6ce4f17a17e9ab: start","job_status":"start","queue_duration_s":1.317287,"scheduling_latency_s":1.317302}1312gitlab # [ 237.654116] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"repository_check","args":["default"],"class":"RepositoryCheck::BatchWorker","jid":"fe0f86aa0b6ce4f17a17e9ab","created_at":"2026-08-20T08:20:07.874Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cbedbd6bda814aff","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"RepositoryCheck::DispatchWorker","correlation_id":"6b15820348b68b017029bc32e1569c68","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b22e99a0acd71e0cf2962b3ba955d6f34621628300baf74d4c861b087bc17605","size_limiter":"validated","enqueued_at":"2026-08-20T08:20:07.878Z","job_size_bytes":11,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryCheck::BatchWorker JID-fe0f86aa0b6ce4f17a17e9ab: done: 0.031001 sec","job_status":"done","queue_duration_s":1.317287,"scheduling_latency_s":1.317302,"redis_calls":13,"redis_duration_s":0.00358,"redis_read_bytes":12,"redis_write_bytes":1387,"redis_cache_calls":1,"redis_cache_duration_s":0.000388,"redis_cache_read_bytes":1,"redis_cache_write_bytes":37,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001228,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":513,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00697646,"duration_s":0.031001,"completed_at":"2026-08-20T08:20:09.226Z","load_balancing_strategy":"primary","db_duration_s":0.003784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 237.698757] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5119d9557e329bf276e462f3","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5119d9557e329bf276e462f3: start","job_status":"start","queue_duration_s":0.745874,"scheduling_latency_s":0.74589}1314gitlab # [ 237.711302] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5119d9557e329bf276e462f3","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5119d9557e329bf276e462f3: done: 0.022204 sec","job_status":"done","queue_duration_s":0.745874,"scheduling_latency_s":0.74589,"redis_calls":16,"redis_duration_s":0.003839,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002091,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034786,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022204,"completed_at":"2026-08-20T08:20:09.250Z","load_balancing_strategy":"primary","db_duration_s":0.000652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 237.752779] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"279c94ce9313b88430b808f6","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-279c94ce9313b88430b808f6: start","job_status":"start","queue_duration_s":0.769547,"scheduling_latency_s":0.769562}1316gitlab # [ 237.765293] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"279c94ce9313b88430b808f6","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-279c94ce9313b88430b808f6: done: 0.016433 sec","job_status":"done","queue_duration_s":0.769547,"scheduling_latency_s":0.769562,"redis_calls":13,"redis_duration_s":0.0029319999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016433,"completed_at":"2026-08-20T08:20:09.268Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 237.804540] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"218fce4ee20456905164c70d","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-218fce4ee20456905164c70d: start","job_status":"start","queue_duration_s":0.787409,"scheduling_latency_s":0.787424}1318gitlab # [ 237.816955] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"218fce4ee20456905164c70d","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-218fce4ee20456905164c70d: done: 0.015868 sec","job_status":"done","queue_duration_s":0.787409,"scheduling_latency_s":0.787424,"redis_calls":13,"redis_duration_s":0.002797,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015868,"completed_at":"2026-08-20T08:20:09.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 237.856715] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e8c06f37bd1883eb33aa225","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e8c06f37bd1883eb33aa225: start","job_status":"start","queue_duration_s":0.804726,"scheduling_latency_s":0.804741}1320gitlab # [ 237.869970] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e8c06f37bd1883eb33aa225","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e8c06f37bd1883eb33aa225: done: 0.015409 sec","job_status":"done","queue_duration_s":0.804726,"scheduling_latency_s":0.804741,"redis_calls":13,"redis_duration_s":0.002923,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015409,"completed_at":"2026-08-20T08:20:09.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 237.909384] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"604ddb66bfb5f1a5d1c75f82","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-604ddb66bfb5f1a5d1c75f82: start","job_status":"start","queue_duration_s":0.8216,"scheduling_latency_s":0.821615}1322gitlab # [ 237.922046] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"604ddb66bfb5f1a5d1c75f82","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-604ddb66bfb5f1a5d1c75f82: done: 0.015546 sec","job_status":"done","queue_duration_s":0.8216,"scheduling_latency_s":0.821615,"redis_calls":13,"redis_duration_s":0.002866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015546,"completed_at":"2026-08-20T08:20:09.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 237.961566] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8481a3e49938bf8ccb81a7f6","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8481a3e49938bf8ccb81a7f6: start","job_status":"start","queue_duration_s":0.838552,"scheduling_latency_s":0.838567}1324gitlab # [ 237.973711] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8481a3e49938bf8ccb81a7f6","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8481a3e49938bf8ccb81a7f6: done: 0.015604 sec","job_status":"done","queue_duration_s":0.838552,"scheduling_latency_s":0.838567,"redis_calls":13,"redis_duration_s":0.00282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015604,"completed_at":"2026-08-20T08:20:09.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 238.013011] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f55752560258c5827d5de77b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f55752560258c5827d5de77b: start","job_status":"start","queue_duration_s":0.855533,"scheduling_latency_s":0.855548}1326gitlab # [ 238.025445] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f55752560258c5827d5de77b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f55752560258c5827d5de77b: done: 0.01594 sec","job_status":"done","queue_duration_s":0.855533,"scheduling_latency_s":0.855548,"redis_calls":13,"redis_duration_s":0.002719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009599,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01594,"completed_at":"2026-08-20T08:20:09.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 238.064890] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"353b788c3e8a7ca6cd97c037","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-353b788c3e8a7ca6cd97c037: start","job_status":"start","queue_duration_s":0.872887,"scheduling_latency_s":0.872902}1328gitlab # [ 238.078623] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"353b788c3e8a7ca6cd97c037","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-353b788c3e8a7ca6cd97c037: done: 0.015272 sec","job_status":"done","queue_duration_s":0.872887,"scheduling_latency_s":0.872902,"redis_calls":13,"redis_duration_s":0.002882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015272,"completed_at":"2026-08-20T08:20:09.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 238.118636] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"474ae84fd736acb7fff1ef1f","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-474ae84fd736acb7fff1ef1f: start","job_status":"start","queue_duration_s":0.889549,"scheduling_latency_s":0.889564}1330gitlab # [ 238.131444] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"474ae84fd736acb7fff1ef1f","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-474ae84fd736acb7fff1ef1f: done: 0.015744 sec","job_status":"done","queue_duration_s":0.889549,"scheduling_latency_s":0.889564,"redis_calls":13,"redis_duration_s":0.003044,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015744,"completed_at":"2026-08-20T08:20:09.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 238.171602] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869c072ba96aff523dd58227","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869c072ba96aff523dd58227: start","job_status":"start","queue_duration_s":0.906616,"scheduling_latency_s":0.906631}1332gitlab # [ 238.184392] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"869c072ba96aff523dd58227","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-869c072ba96aff523dd58227: done: 0.015574 sec","job_status":"done","queue_duration_s":0.906616,"scheduling_latency_s":0.906631,"redis_calls":13,"redis_duration_s":0.00311,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001313,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015574,"completed_at":"2026-08-20T08:20:09.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 238.224279] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7acd719d7dc497d40192464e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7acd719d7dc497d40192464e: start","job_status":"start","queue_duration_s":0.923585,"scheduling_latency_s":0.9236}1334gitlab # [ 238.236639] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7acd719d7dc497d40192464e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7acd719d7dc497d40192464e: done: 0.015827 sec","job_status":"done","queue_duration_s":0.923585,"scheduling_latency_s":0.9236,"redis_calls":13,"redis_duration_s":0.002816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015827,"completed_at":"2026-08-20T08:20:09.422Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 238.277780] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c00dec4a45070aa9dfd8d4e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c00dec4a45070aa9dfd8d4e: start","job_status":"start","queue_duration_s":0.94132,"scheduling_latency_s":0.941336}1336gitlab # [ 238.290364] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c00dec4a45070aa9dfd8d4e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c00dec4a45070aa9dfd8d4e: done: 0.016908 sec","job_status":"done","queue_duration_s":0.94132,"scheduling_latency_s":0.941336,"redis_calls":13,"redis_duration_s":0.00285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016908,"completed_at":"2026-08-20T08:20:09.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 238.329862] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b716523bb767a272491e1f1","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b716523bb767a272491e1f1: start","job_status":"start","queue_duration_s":0.960088,"scheduling_latency_s":0.960104}1338gitlab # [ 238.342156] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b716523bb767a272491e1f1","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b716523bb767a272491e1f1: done: 0.016981 sec","job_status":"done","queue_duration_s":0.960088,"scheduling_latency_s":0.960104,"redis_calls":13,"redis_duration_s":0.002961,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016981,"completed_at":"2026-08-20T08:20:09.459Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 238.381413] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c67b491d75db97eeb4f980b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c67b491d75db97eeb4f980b: start","job_status":"start","queue_duration_s":0.97884,"scheduling_latency_s":0.978857}1340gitlab # [ 238.393621] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c67b491d75db97eeb4f980b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c67b491d75db97eeb4f980b: done: 0.016659 sec","job_status":"done","queue_duration_s":0.97884,"scheduling_latency_s":0.978857,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016659,"completed_at":"2026-08-20T08:20:09.478Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 238.432747] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14feaa4f88d77d6505ca57fa","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14feaa4f88d77d6505ca57fa: start","job_status":"start","queue_duration_s":0.996877,"scheduling_latency_s":0.996892}1342gitlab # [ 238.444979] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14feaa4f88d77d6505ca57fa","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14feaa4f88d77d6505ca57fa: done: 0.016675 sec","job_status":"done","queue_duration_s":0.996877,"scheduling_latency_s":0.996892,"redis_calls":13,"redis_duration_s":0.002738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016675,"completed_at":"2026-08-20T08:20:09.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 238.485221] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"957be21addaa750f3ae4720c","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-957be21addaa750f3ae4720c: start","job_status":"start","queue_duration_s":1.014868,"scheduling_latency_s":1.014883}1344gitlab # [ 238.497563] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"957be21addaa750f3ae4720c","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-957be21addaa750f3ae4720c: done: 0.018019 sec","job_status":"done","queue_duration_s":1.014868,"scheduling_latency_s":1.014883,"redis_calls":13,"redis_duration_s":0.003229,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018019,"completed_at":"2026-08-20T08:20:09.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 238.536510] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70e92fc9465392a68a105f82","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70e92fc9465392a68a105f82: start","job_status":"start","queue_duration_s":1.034267,"scheduling_latency_s":1.034282}1346gitlab # [ 238.548784] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70e92fc9465392a68a105f82","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70e92fc9465392a68a105f82: done: 0.017319 sec","job_status":"done","queue_duration_s":1.034267,"scheduling_latency_s":1.034282,"redis_calls":13,"redis_duration_s":0.003383,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002429,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017319,"completed_at":"2026-08-20T08:20:09.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 238.587947] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"356257f8c97cb5f39ed3cfad","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-356257f8c97cb5f39ed3cfad: start","job_status":"start","queue_duration_s":1.052956,"scheduling_latency_s":1.052971}1348gitlab # [ 238.600582] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"356257f8c97cb5f39ed3cfad","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-356257f8c97cb5f39ed3cfad: done: 0.016995 sec","job_status":"done","queue_duration_s":1.052956,"scheduling_latency_s":1.052971,"redis_calls":13,"redis_duration_s":0.00269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016995,"completed_at":"2026-08-20T08:20:09.552Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 238.639862] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c3c768bf9bad2dd5621111","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c3c768bf9bad2dd5621111: start","job_status":"start","queue_duration_s":1.071322,"scheduling_latency_s":1.071337}1350gitlab # [ 238.652624] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79c3c768bf9bad2dd5621111","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79c3c768bf9bad2dd5621111: done: 0.016419 sec","job_status":"done","queue_duration_s":1.071322,"scheduling_latency_s":1.071337,"redis_calls":13,"redis_duration_s":0.003202,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016419,"completed_at":"2026-08-20T08:20:09.570Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 238.693208] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aeedac7a93ae342d012dc16","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aeedac7a93ae342d012dc16: start","job_status":"start","queue_duration_s":1.089648,"scheduling_latency_s":1.089664}1352gitlab # [ 238.706073] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aeedac7a93ae342d012dc16","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aeedac7a93ae342d012dc16: done: 0.017036 sec","job_status":"done","queue_duration_s":1.089648,"scheduling_latency_s":1.089664,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017036,"completed_at":"2026-08-20T08:20:09.589Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 238.745551] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f42b193f547a1266ff2ab392","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f42b193f547a1266ff2ab392: start","job_status":"start","queue_duration_s":1.108525,"scheduling_latency_s":1.10854}1354gitlab # [ 238.758004] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f42b193f547a1266ff2ab392","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f42b193f547a1266ff2ab392: done: 0.016729 sec","job_status":"done","queue_duration_s":1.108525,"scheduling_latency_s":1.10854,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016729,"completed_at":"2026-08-20T08:20:09.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 238.797589] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"077e093dc9641072d6c3001b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-077e093dc9641072d6c3001b: start","job_status":"start","queue_duration_s":1.126916,"scheduling_latency_s":1.126932}1356gitlab # [ 238.809972] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"077e093dc9641072d6c3001b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-077e093dc9641072d6c3001b: done: 0.016519 sec","job_status":"done","queue_duration_s":1.126916,"scheduling_latency_s":1.126932,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016519,"completed_at":"2026-08-20T08:20:09.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 238.849564] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0c9ffd929d3331410d080e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0c9ffd929d3331410d080e: start","job_status":"start","queue_duration_s":1.145382,"scheduling_latency_s":1.145399}1358gitlab # [ 238.862084] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0c9ffd929d3331410d080e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0c9ffd929d3331410d080e: done: 0.017253 sec","job_status":"done","queue_duration_s":1.145382,"scheduling_latency_s":1.145399,"redis_calls":13,"redis_duration_s":0.002972,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017253,"completed_at":"2026-08-20T08:20:09.645Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 238.902035] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07cad9d82413cce2cce3a7c5","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07cad9d82413cce2cce3a7c5: start","job_status":"start","queue_duration_s":1.164538,"scheduling_latency_s":1.164569}1360gitlab # [ 238.914595] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07cad9d82413cce2cce3a7c5","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07cad9d82413cce2cce3a7c5: done: 0.016802 sec","job_status":"done","queue_duration_s":1.164538,"scheduling_latency_s":1.164569,"redis_calls":13,"redis_duration_s":0.00332,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001448,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016802,"completed_at":"2026-08-20T08:20:09.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 238.954120] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1f04d3724efc6233bfeac5","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1f04d3724efc6233bfeac5: start","job_status":"start","queue_duration_s":1.182704,"scheduling_latency_s":1.18272}1362gitlab # [ 238.966640] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1f04d3724efc6233bfeac5","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1f04d3724efc6233bfeac5: done: 0.020176 sec","job_status":"done","queue_duration_s":1.182704,"scheduling_latency_s":1.18272,"redis_calls":13,"redis_duration_s":0.002987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020176,"completed_at":"2026-08-20T08:20:09.685Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 239.005982] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"299063932b2ab12c40ab357b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-299063932b2ab12c40ab357b: start","job_status":"start","queue_duration_s":1.204308,"scheduling_latency_s":1.204323}1364gitlab # [ 239.018348] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"299063932b2ab12c40ab357b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-299063932b2ab12c40ab357b: done: 0.017508 sec","job_status":"done","queue_duration_s":1.204308,"scheduling_latency_s":1.204323,"redis_calls":13,"redis_duration_s":0.003116,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017508,"completed_at":"2026-08-20T08:20:09.704Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 239.057917] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d48488f5e9a9025f87386cf","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d48488f5e9a9025f87386cf: start","job_status":"start","queue_duration_s":1.223453,"scheduling_latency_s":1.223468}1366gitlab # [ 239.070876] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d48488f5e9a9025f87386cf","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d48488f5e9a9025f87386cf: done: 0.017114 sec","job_status":"done","queue_duration_s":1.223453,"scheduling_latency_s":1.223468,"redis_calls":13,"redis_duration_s":0.002774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017114,"completed_at":"2026-08-20T08:20:09.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 239.112666] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c71290b8bd88d3b99ddc00dd","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c71290b8bd88d3b99ddc00dd: start","job_status":"start","queue_duration_s":1.241969,"scheduling_latency_s":1.241984}1368gitlab # [ 239.125465] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c71290b8bd88d3b99ddc00dd","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c71290b8bd88d3b99ddc00dd: done: 0.017684 sec","job_status":"done","queue_duration_s":1.241969,"scheduling_latency_s":1.241984,"redis_calls":13,"redis_duration_s":0.002908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017684,"completed_at":"2026-08-20T08:20:09.742Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 239.165781] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2650ec94f36464a3c509d560","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2650ec94f36464a3c509d560: start","job_status":"start","queue_duration_s":1.261121,"scheduling_latency_s":1.261135}1370gitlab # [ 239.178637] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2650ec94f36464a3c509d560","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2650ec94f36464a3c509d560: done: 0.017458 sec","job_status":"done","queue_duration_s":1.261121,"scheduling_latency_s":1.261135,"redis_calls":13,"redis_duration_s":0.002848,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017458,"completed_at":"2026-08-20T08:20:09.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 239.219195] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a63160c1eb347129e856cd13","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a63160c1eb347129e856cd13: start","job_status":"start","queue_duration_s":1.28059,"scheduling_latency_s":1.280608}1372gitlab # [ 239.232211] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a63160c1eb347129e856cd13","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a63160c1eb347129e856cd13: done: 0.016502 sec","job_status":"done","queue_duration_s":1.28059,"scheduling_latency_s":1.280608,"redis_calls":13,"redis_duration_s":0.002943,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016502,"completed_at":"2026-08-20T08:20:09.779Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 239.272747] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e645c566cfc4d1d1bf775e0","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e645c566cfc4d1d1bf775e0: start","job_status":"start","queue_duration_s":1.298647,"scheduling_latency_s":1.298662}1374gitlab # [ 239.285816] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e645c566cfc4d1d1bf775e0","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e645c566cfc4d1d1bf775e0: done: 0.015327 sec","job_status":"done","queue_duration_s":1.298647,"scheduling_latency_s":1.298662,"redis_calls":13,"redis_duration_s":0.002832,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015327,"completed_at":"2026-08-20T08:20:09.796Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 239.327433] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a448351a1d891ebd83d04425","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a448351a1d891ebd83d04425: start","job_status":"start","queue_duration_s":1.315394,"scheduling_latency_s":1.31541}1376gitlab # [ 239.340330] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a448351a1d891ebd83d04425","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a448351a1d891ebd83d04425: done: 0.015857 sec","job_status":"done","queue_duration_s":1.315394,"scheduling_latency_s":1.31541,"redis_calls":13,"redis_duration_s":0.003293,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015857,"completed_at":"2026-08-20T08:20:09.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 239.380853] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eac76b8904910f1289450a23","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eac76b8904910f1289450a23: start","job_status":"start","queue_duration_s":1.332668,"scheduling_latency_s":1.332684}1378gitlab # [ 239.393464] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eac76b8904910f1289450a23","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eac76b8904910f1289450a23: done: 0.014836 sec","job_status":"done","queue_duration_s":1.332668,"scheduling_latency_s":1.332684,"redis_calls":13,"redis_duration_s":0.0025510000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001613,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014836,"completed_at":"2026-08-20T08:20:09.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 239.433973] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d41db553b93750a2e0ad4a96","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d41db553b93750a2e0ad4a96: start","job_status":"start","queue_duration_s":1.348971,"scheduling_latency_s":1.348988}1380gitlab # [ 239.446670] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d41db553b93750a2e0ad4a96","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d41db553b93750a2e0ad4a96: done: 0.015102 sec","job_status":"done","queue_duration_s":1.348971,"scheduling_latency_s":1.348988,"redis_calls":13,"redis_duration_s":0.0017790000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015102,"completed_at":"2026-08-20T08:20:09.846Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 239.486699] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4c8d92794825ceabaa51b3a","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4c8d92794825ceabaa51b3a: start","job_status":"start","queue_duration_s":1.365534,"scheduling_latency_s":1.365552}1382gitlab # [ 239.499798] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4c8d92794825ceabaa51b3a","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4c8d92794825ceabaa51b3a: done: 0.015313 sec","job_status":"done","queue_duration_s":1.365534,"scheduling_latency_s":1.365552,"redis_calls":13,"redis_duration_s":0.0016099999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015313,"completed_at":"2026-08-20T08:20:09.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 239.540414] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d82829c2d94d64b78b9645a3","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d82829c2d94d64b78b9645a3: start","job_status":"start","queue_duration_s":1.382143,"scheduling_latency_s":1.382161}1384gitlab # [ 239.552745] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.879Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d82829c2d94d64b78b9645a3","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d82829c2d94d64b78b9645a3: done: 0.014665 sec","job_status":"done","queue_duration_s":1.382143,"scheduling_latency_s":1.382161,"redis_calls":13,"redis_duration_s":0.0015890000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014665,"completed_at":"2026-08-20T08:20:09.879Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 239.592080] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2426ab13210c5d8dfdc758a9","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2426ab13210c5d8dfdc758a9: start","job_status":"start","queue_duration_s":1.397932,"scheduling_latency_s":1.397949}1386gitlab # [ 239.604354] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2426ab13210c5d8dfdc758a9","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2426ab13210c5d8dfdc758a9: done: 0.014159 sec","job_status":"done","queue_duration_s":1.397932,"scheduling_latency_s":1.397949,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014159,"completed_at":"2026-08-20T08:20:09.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 239.643160] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23dc62500b832fa52afc0480","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23dc62500b832fa52afc0480: start","job_status":"start","queue_duration_s":1.413262,"scheduling_latency_s":1.413278}1388gitlab # [ 239.655697] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23dc62500b832fa52afc0480","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23dc62500b832fa52afc0480: done: 0.014817 sec","job_status":"done","queue_duration_s":1.413262,"scheduling_latency_s":1.413278,"redis_calls":13,"redis_duration_s":0.0018729999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014817,"completed_at":"2026-08-20T08:20:09.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 239.696433] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c426e11c83db1f9c910a9612","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c426e11c83db1f9c910a9612: start","job_status":"start","queue_duration_s":1.429287,"scheduling_latency_s":1.429303}1390gitlab # [ 239.710279] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c426e11c83db1f9c910a9612","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c426e11c83db1f9c910a9612: done: 0.014175 sec","job_status":"done","queue_duration_s":1.429287,"scheduling_latency_s":1.429303,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014175,"completed_at":"2026-08-20T08:20:09.926Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 239.750063] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"550cf116997ca53d2b0d9628","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-550cf116997ca53d2b0d9628: start","job_status":"start","queue_duration_s":1.444639,"scheduling_latency_s":1.444656}1392gitlab # [ 239.762738] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"550cf116997ca53d2b0d9628","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-550cf116997ca53d2b0d9628: done: 0.014154 sec","job_status":"done","queue_duration_s":1.444639,"scheduling_latency_s":1.444656,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014154,"completed_at":"2026-08-20T08:20:09.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 239.802645] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b95481b8698fa1f9183dc9e9","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b95481b8698fa1f9183dc9e9: start","job_status":"start","queue_duration_s":1.459941,"scheduling_latency_s":1.459957}1394gitlab # [ 239.815310] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b95481b8698fa1f9183dc9e9","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b95481b8698fa1f9183dc9e9: done: 0.014193 sec","job_status":"done","queue_duration_s":1.459941,"scheduling_latency_s":1.459957,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014193,"completed_at":"2026-08-20T08:20:09.956Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 239.855284] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68484b3b16793186d290d6be","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68484b3b16793186d290d6be: start","job_status":"start","queue_duration_s":1.475317,"scheduling_latency_s":1.475332}1396gitlab # [ 239.867952] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68484b3b16793186d290d6be","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68484b3b16793186d290d6be: done: 0.014186 sec","job_status":"done","queue_duration_s":1.475317,"scheduling_latency_s":1.475332,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014186,"completed_at":"2026-08-20T08:20:09.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 239.907923] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a6e4572bb28524110c61e0e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a6e4572bb28524110c61e0e: start","job_status":"start","queue_duration_s":1.490832,"scheduling_latency_s":1.490849}1398gitlab # [ 239.922075] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a6e4572bb28524110c61e0e","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a6e4572bb28524110c61e0e: done: 0.014021 sec","job_status":"done","queue_duration_s":1.490832,"scheduling_latency_s":1.490849,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014021,"completed_at":"2026-08-20T08:20:09.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 239.961738] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:09.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a595a5627a31f8d54c739539","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a595a5627a31f8d54c739539: start","job_status":"start","queue_duration_s":1.506031,"scheduling_latency_s":1.506047}1400gitlab # [ 239.974531] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a595a5627a31f8d54c739539","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a595a5627a31f8d54c739539: done: 0.013974 sec","job_status":"done","queue_duration_s":1.506031,"scheduling_latency_s":1.506047,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013974,"completed_at":"2026-08-20T08:20:10.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 240.014159] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be19d9a5310719ddefec9bb5","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be19d9a5310719ddefec9bb5: start","job_status":"start","queue_duration_s":1.521185,"scheduling_latency_s":1.521202}1402gitlab # [ 240.026826] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be19d9a5310719ddefec9bb5","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be19d9a5310719ddefec9bb5: done: 0.014491 sec","job_status":"done","queue_duration_s":1.521185,"scheduling_latency_s":1.521202,"redis_calls":13,"redis_duration_s":0.0015309999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014491,"completed_at":"2026-08-20T08:20:10.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 240.066775] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fce2ac35cd9aad4e1ffaf34","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fce2ac35cd9aad4e1ffaf34: start","job_status":"start","queue_duration_s":1.536929,"scheduling_latency_s":1.536946}1404gitlab # [ 240.079581] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fce2ac35cd9aad4e1ffaf34","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fce2ac35cd9aad4e1ffaf34: done: 0.016088 sec","job_status":"done","queue_duration_s":1.536929,"scheduling_latency_s":1.536946,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016088,"completed_at":"2026-08-20T08:20:10.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 240.119953] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df4c35b1a4f578d22e729c6b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df4c35b1a4f578d22e729c6b: start","job_status":"start","queue_duration_s":1.554221,"scheduling_latency_s":1.554237}1406gitlab # [ 240.132549] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df4c35b1a4f578d22e729c6b","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df4c35b1a4f578d22e729c6b: done: 0.014044 sec","job_status":"done","queue_duration_s":1.554221,"scheduling_latency_s":1.554237,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014044,"completed_at":"2026-08-20T08:20:10.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 240.171582] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47140bb7144bc2fd7a266e9c","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47140bb7144bc2fd7a266e9c: start","job_status":"start","queue_duration_s":1.569512,"scheduling_latency_s":1.569529}1408gitlab # [ 240.184220] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47140bb7144bc2fd7a266e9c","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47140bb7144bc2fd7a266e9c: done: 0.01453 sec","job_status":"done","queue_duration_s":1.569512,"scheduling_latency_s":1.569529,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01453,"completed_at":"2026-08-20T08:20:10.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 240.224298] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"affa2a26d574cfa7b861c5d9","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-affa2a26d574cfa7b861c5d9: start","job_status":"start","queue_duration_s":1.585291,"scheduling_latency_s":1.585309}1410gitlab # [ 240.237009] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"affa2a26d574cfa7b861c5d9","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-affa2a26d574cfa7b861c5d9: done: 0.014519 sec","job_status":"done","queue_duration_s":1.585291,"scheduling_latency_s":1.585309,"redis_calls":13,"redis_duration_s":0.0015559999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014519,"completed_at":"2026-08-20T08:20:10.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 240.277085] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53d3ec5e7d799b99a9eed7ff","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53d3ec5e7d799b99a9eed7ff: start","job_status":"start","queue_duration_s":1.601041,"scheduling_latency_s":1.601057}1412gitlab # [ 240.289781] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:20:10.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53d3ec5e7d799b99a9eed7ff","created_at":"2026-08-20T08:20:08.392Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1c2d948537634a3d","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"486222e99f98d7ec7d8476f4af1b601f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:20:08.482Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53d3ec5e7d799b99a9eed7ff: done: 0.01403 sec","job_status":"done","queue_duration_s":1.601041,"scheduling_latency_s":1.601057,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01403,"completed_at":"2026-08-20T08:20:10.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 272.961696] setup-gitlab-start[2965]: W, [2026-08-20T08:20:44.849524 #2965] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1414gitlab # [ 290.815586] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:02.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c22fe812c57dc889c07ff354","created_at":"2026-08-20T08:21:02.683Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a4c22e362f260e8b16e2eeaaf6ee853","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.699Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c22fe812c57dc889c07ff354: start","job_status":"start","queue_duration_s":0.002951,"scheduling_latency_s":0.002995}1415gitlab # [ 291.113709] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"c22fe812c57dc889c07ff354","created_at":"2026-08-20T08:21:02.683Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a4c22e362f260e8b16e2eeaaf6ee853","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.699Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-c22fe812c57dc889c07ff354: done: 0.298189 sec","job_status":"done","queue_duration_s":0.002951,"scheduling_latency_s":0.002995,"redis_calls":15,"redis_duration_s":0.0157,"redis_read_bytes":775,"redis_write_bytes":1562,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00274,"redis_feature_flag_read_bytes":768,"redis_feature_flag_write_bytes":400,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005103,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.087,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00314732,"exclusive_lock_hold_duration_s":0.19935496,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.298189,"completed_at":"2026-08-20T08:21:03.000Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.204927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 291.213248] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.024Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e62dcc77b5399a2b9e32b52a","created_at":"2026-08-20T08:21:02.740Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15cba3a4f2ef6d888617e940298b56df","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.753Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e62dcc77b5399a2b9e32b52a: start","job_status":"start","queue_duration_s":0.271547,"scheduling_latency_s":0.2716}1417gitlab # [ 291.312425] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.199Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e62dcc77b5399a2b9e32b52a","created_at":"2026-08-20T08:21:02.740Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15cba3a4f2ef6d888617e940298b56df","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.753Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e62dcc77b5399a2b9e32b52a: done: 0.174943 sec","job_status":"done","queue_duration_s":0.271547,"scheduling_latency_s":0.2716,"redis_calls":10,"redis_duration_s":0.0184,"redis_read_bytes":135,"redis_write_bytes":1136,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001363,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004874,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00213122,"exclusive_lock_hold_duration_s":0.0248074,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.174943,"completed_at":"2026-08-20T08:21:03.199Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 291.407824] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"04aec9dcb80379d39855cd12","created_at":"2026-08-20T08:21:02.783Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1329f235247854ef96b378dda0201b5a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.789Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-04aec9dcb80379d39855cd12: start","job_status":"start","queue_duration_s":0.420212,"scheduling_latency_s":0.420256}1419gitlab # [ 291.426441] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"04aec9dcb80379d39855cd12","created_at":"2026-08-20T08:21:02.783Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1329f235247854ef96b378dda0201b5a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.789Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-04aec9dcb80379d39855cd12: done: 0.092068 sec","job_status":"done","queue_duration_s":0.420212,"scheduling_latency_s":0.420256,"redis_calls":8,"redis_duration_s":0.017459,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000499,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011466,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092068,"completed_at":"2026-08-20T08:21:03.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 291.470856] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bb96aa11e1ebbd2e1d4c1084","created_at":"2026-08-20T08:21:02.814Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71e3a76750bfbb830bb5d0802d8c751a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.820Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bb96aa11e1ebbd2e1d4c1084: start","job_status":"start","queue_duration_s":0.489382,"scheduling_latency_s":0.489434}1421gitlab # [ 291.497787] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bb96aa11e1ebbd2e1d4c1084","created_at":"2026-08-20T08:21:02.814Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71e3a76750bfbb830bb5d0802d8c751a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.820Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bb96aa11e1ebbd2e1d4c1084: done: 0.074783 sec","job_status":"done","queue_duration_s":0.489382,"scheduling_latency_s":0.489434,"redis_calls":7,"redis_duration_s":0.016232,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074783,"completed_at":"2026-08-20T08:21:03.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 291.548823] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7c002164c032d188fe71e4b5","created_at":"2026-08-20T08:21:02.850Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52fd16bd453d59a9efd3d348ea73c923","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.858Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7c002164c032d188fe71e4b5: start","job_status":"start","queue_duration_s":0.561688,"scheduling_latency_s":0.561742}1423gitlab # [ 291.573709] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.461Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1424gitlab # [ 291.605430] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.492Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7c002164c032d188fe71e4b5","created_at":"2026-08-20T08:21:02.850Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52fd16bd453d59a9efd3d348ea73c923","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.858Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7c002164c032d188fe71e4b5: done: 0.072296 sec","job_status":"done","queue_duration_s":0.561688,"scheduling_latency_s":0.561742,"redis_calls":7,"redis_duration_s":0.018448,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.015966,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.072296,"completed_at":"2026-08-20T08:21:03.492Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 291.697389] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"756b81e2cb69390aa97f85c8","created_at":"2026-08-20T08:21:02.869Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1075f63ade38be1e5ed87c1f9f25ebd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:21:02.874Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-756b81e2cb69390aa97f85c8: start","job_status":"start","queue_duration_s":0.622623,"scheduling_latency_s":0.622691}1426gitlab # [ 291.715083] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"756b81e2cb69390aa97f85c8","created_at":"2026-08-20T08:21:02.869Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1075f63ade38be1e5ed87c1f9f25ebd4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:21:02.874Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-756b81e2cb69390aa97f85c8: done: 0.034896 sec","job_status":"done","queue_duration_s":0.622623,"scheduling_latency_s":0.622691,"redis_calls":7,"redis_duration_s":0.0021479999999999997,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001674,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034896,"completed_at":"2026-08-20T08:21:03.531Z","load_balancing_strategy":"primary","db_duration_s":0.006041,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 291.759354] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"79d7f479a6dbc6d97acbfff6","created_at":"2026-08-20T08:21:02.925Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da8962b58b00aaa07b36ce9684aa95ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.935Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-79d7f479a6dbc6d97acbfff6: start","job_status":"start","queue_duration_s":0.598104,"scheduling_latency_s":0.598135}1428gitlab # [ 291.775250] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"79d7f479a6dbc6d97acbfff6","created_at":"2026-08-20T08:21:02.925Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da8962b58b00aaa07b36ce9684aa95ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.935Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-79d7f479a6dbc6d97acbfff6: done: 0.070538 sec","job_status":"done","queue_duration_s":0.598104,"scheduling_latency_s":0.598135,"redis_calls":9,"redis_duration_s":0.003336,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001605,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101742,"exclusive_lock_hold_duration_s":0.02869842,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.070538,"completed_at":"2026-08-20T08:21:03.604Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 291.819911] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"08aa3e86531f60daae96cf2b","created_at":"2026-08-20T08:21:02.952Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a087f78f267da543559dad25dfa09d2f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.966Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-08aa3e86531f60daae96cf2b: start","job_status":"start","queue_duration_s":0.640825,"scheduling_latency_s":0.640862}1430gitlab # [ 291.834511] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"08aa3e86531f60daae96cf2b","created_at":"2026-08-20T08:21:02.952Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a087f78f267da543559dad25dfa09d2f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.966Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-08aa3e86531f60daae96cf2b: done: 0.034659 sec","job_status":"done","queue_duration_s":0.640825,"scheduling_latency_s":0.640862,"redis_calls":10,"redis_duration_s":0.003447,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002042,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00818028,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034659,"completed_at":"2026-08-20T08:21:03.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004176,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1431gitlab # [ 291.877350] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3b995388c349e102013945ce","created_at":"2026-08-20T08:21:02.990Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67bffa705470c4497e087ea86e25c1ce","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.996Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3b995388c349e102013945ce: start","job_status":"start","queue_duration_s":0.647405,"scheduling_latency_s":0.647431}1432gitlab # [ 291.891067] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"3b995388c349e102013945ce","created_at":"2026-08-20T08:21:02.990Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67bffa705470c4497e087ea86e25c1ce","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:02.996Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-3b995388c349e102013945ce: done: 0.040225 sec","job_status":"done","queue_duration_s":0.647405,"scheduling_latency_s":0.647431,"redis_calls":7,"redis_duration_s":0.0026249999999999997,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.040225,"completed_at":"2026-08-20T08:21:03.684Z","load_balancing_strategy":"primary","db_duration_s":0.017023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 291.932298] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.687Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f6d5560c8ce71448390ee9d3","created_at":"2026-08-20T08:21:03.026Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55d3a102a3802c6a9ca1911dff3c713e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.033Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f6d5560c8ce71448390ee9d3: start","job_status":"start","queue_duration_s":0.653274,"scheduling_latency_s":0.653304}1434gitlab # [ 291.947872] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.700Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1435gitlab # [ 291.951208] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f6d5560c8ce71448390ee9d3","created_at":"2026-08-20T08:21:03.026Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"55d3a102a3802c6a9ca1911dff3c713e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.033Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f6d5560c8ce71448390ee9d3: done: 0.02232 sec","job_status":"done","queue_duration_s":0.653274,"scheduling_latency_s":0.653304,"redis_calls":7,"redis_duration_s":0.002429,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000648,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02232,"completed_at":"2026-08-20T08:21:03.709Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 291.992004] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"fdfd9230567ec7365e135a92","created_at":"2026-08-20T08:21:03.047Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.052Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-fdfd9230567ec7365e135a92: start","job_status":"start","queue_duration_s":0.658903,"scheduling_latency_s":0.658927}1437gitlab # [ 292.005383] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"fdfd9230567ec7365e135a92","created_at":"2026-08-20T08:21:03.047Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.052Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-fdfd9230567ec7365e135a92: done: 0.035569 sec","job_status":"done","queue_duration_s":0.658903,"scheduling_latency_s":0.658927,"redis_calls":14,"redis_duration_s":0.0039570000000000004,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000477,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002559,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035569,"completed_at":"2026-08-20T08:21:03.746Z","load_balancing_strategy":"primary","db_duration_s":0.002371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 292.046422] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2f44dc68d73ba951e1569bf6","created_at":"2026-08-20T08:21:03.087Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3acab13b1526fce813a0fd75314774b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.091Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2f44dc68d73ba951e1569bf6: start","job_status":"start","queue_duration_s":0.657106,"scheduling_latency_s":0.657129}1439gitlab # [ 292.061121] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.758Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1440gitlab # [ 292.064851] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.765Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2f44dc68d73ba951e1569bf6","created_at":"2026-08-20T08:21:03.087Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3acab13b1526fce813a0fd75314774b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.091Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2f44dc68d73ba951e1569bf6: done: 0.016179 sec","job_status":"done","queue_duration_s":0.657106,"scheduling_latency_s":0.657129,"redis_calls":7,"redis_duration_s":0.0019160000000000002,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016179,"completed_at":"2026-08-20T08:21:03.764Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 292.105691] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7ddc81e918c19e2b03ac8f80","created_at":"2026-08-20T08:21:03.108Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f15678050c376e2a94201fcdec24ac7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:21:03.113Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7ddc81e918c19e2b03ac8f80: start","job_status":"start","queue_duration_s":0.652934,"scheduling_latency_s":0.652979}1442gitlab # [ 292.119158] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.775Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1443gitlab # [ 292.122587] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7ddc81e918c19e2b03ac8f80","created_at":"2026-08-20T08:21:03.108Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f15678050c376e2a94201fcdec24ac7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:21:03.113Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7ddc81e918c19e2b03ac8f80: done: 0.014534 sec","job_status":"done","queue_duration_s":0.652934,"scheduling_latency_s":0.652979,"redis_calls":7,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014534,"completed_at":"2026-08-20T08:21:03.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 292.163860] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"fa3e36a806d32e10236b9d92","created_at":"2026-08-20T08:21:03.118Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d0cce9233c6e48784f78c5edfa80c57","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.132Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-fa3e36a806d32e10236b9d92: start","job_status":"start","queue_duration_s":0.650193,"scheduling_latency_s":0.650209}1445gitlab # [ 292.178078] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"fa3e36a806d32e10236b9d92","created_at":"2026-08-20T08:21:03.118Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d0cce9233c6e48784f78c5edfa80c57","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.132Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-fa3e36a806d32e10236b9d92: done: 0.019221 sec","job_status":"done","queue_duration_s":0.650193,"scheduling_latency_s":0.650209,"redis_calls":9,"redis_duration_s":0.0026160000000000003,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059176,"exclusive_lock_hold_duration_s":0.0044478,"duration_s":0.019221,"completed_at":"2026-08-20T08:21:03.801Z","load_balancing_strategy":"primary","db_duration_s":0.001908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 292.218970] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2b5139d50c24c99cd20e9673","created_at":"2026-08-20T08:21:03.163Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e8bb2e9acbe1acbb2068331922e629d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.168Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2b5139d50c24c99cd20e9673: start","job_status":"start","queue_duration_s":0.635182,"scheduling_latency_s":0.635199}1447gitlab # [ 292.233536] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.820Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2b5139d50c24c99cd20e9673","created_at":"2026-08-20T08:21:03.163Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e8bb2e9acbe1acbb2068331922e629d","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.168Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2b5139d50c24c99cd20e9673: done: 0.016649 sec","job_status":"done","queue_duration_s":0.635182,"scheduling_latency_s":0.635199,"redis_calls":7,"redis_duration_s":0.001872,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000493,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016649,"completed_at":"2026-08-20T08:21:03.820Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 292.274086] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:03.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0ba29b5e5cafa7c1c04e9c17","created_at":"2026-08-20T08:21:03.189Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f2a879c12542e96f15b46975248e141","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.195Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0ba29b5e5cafa7c1c04e9c17: start","job_status":"start","queue_duration_s":0.626204,"scheduling_latency_s":0.626221}1449gitlab # [ 292.288124] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"0ba29b5e5cafa7c1c04e9c17","created_at":"2026-08-20T08:21:03.189Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f2a879c12542e96f15b46975248e141","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.195Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-0ba29b5e5cafa7c1c04e9c17: done: 0.262026 sec","job_status":"done","queue_duration_s":0.626204,"scheduling_latency_s":0.626221,"redis_calls":9,"redis_duration_s":0.002833,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.04,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.215129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060154,"exclusive_lock_hold_duration_s":0.24474332,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.262026,"completed_at":"2026-08-20T08:21:04.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 292.331815] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"51f33d26c450a4015834532b","created_at":"2026-08-20T08:21:03.209Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39e6d2de41fbf96cbae9f0edd8133526","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.216Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-51f33d26c450a4015834532b: start","job_status":"start","queue_duration_s":0.868832,"scheduling_latency_s":0.86885}1451gitlab # [ 292.346477] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.095Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1452gitlab # [ 292.350154] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"51f33d26c450a4015834532b","created_at":"2026-08-20T08:21:03.209Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39e6d2de41fbf96cbae9f0edd8133526","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.216Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-51f33d26c450a4015834532b: done: 0.015849 sec","job_status":"done","queue_duration_s":0.868832,"scheduling_latency_s":0.86885,"redis_calls":7,"redis_duration_s":0.0018340000000000001,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001333,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015849,"completed_at":"2026-08-20T08:21:04.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 292.393699] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cbd155da9fe9b8c7c2475012","created_at":"2026-08-20T08:21:03.242Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.260Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cbd155da9fe9b8c7c2475012: start","job_status":"start","queue_duration_s":0.84299,"scheduling_latency_s":0.843006}1454gitlab # [ 292.407202] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cbd155da9fe9b8c7c2475012","created_at":"2026-08-20T08:21:03.242Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.260Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cbd155da9fe9b8c7c2475012: done: 0.10815 sec","job_status":"done","queue_duration_s":0.84299,"scheduling_latency_s":0.843006,"redis_calls":60,"redis_duration_s":0.017071,"redis_read_bytes":108,"redis_write_bytes":40959,"redis_queues_calls":2,"redis_queues_duration_s":0.000937,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37335,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.015243,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.10815,"completed_at":"2026-08-20T08:21:04.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 292.448798] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"96d66994f3f240dad2de9483","created_at":"2026-08-20T08:21:03.304Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdb334dd4193add3e02cdf0fea0c820a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.324Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-96d66994f3f240dad2de9483: start","job_status":"start","queue_duration_s":0.888042,"scheduling_latency_s":0.888062}1456gitlab # [ 292.534187] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.421Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"96d66994f3f240dad2de9483","created_at":"2026-08-20T08:21:03.304Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cdb334dd4193add3e02cdf0fea0c820a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.324Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-96d66994f3f240dad2de9483: done: 0.209044 sec","job_status":"done","queue_duration_s":0.888042,"scheduling_latency_s":0.888062,"redis_calls":12,"redis_duration_s":0.003525,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000558,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001587,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00138,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.176877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060232,"exclusive_lock_hold_duration_s":0.18276904,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.209044,"completed_at":"2026-08-20T08:21:04.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023566,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1457gitlab # [ 292.579823] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.423Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b2b687250934c40cc6369d64","created_at":"2026-08-20T08:21:03.362Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06d341c5b6037ab413e0d8de9a0dafb7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.372Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b2b687250934c40cc6369d64: start","job_status":"start","queue_duration_s":1.050792,"scheduling_latency_s":1.050811}1458gitlab # [ 292.596214] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.448Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b2b687250934c40cc6369d64","created_at":"2026-08-20T08:21:03.362Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06d341c5b6037ab413e0d8de9a0dafb7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.372Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b2b687250934c40cc6369d64: done: 0.025249 sec","job_status":"done","queue_duration_s":1.050792,"scheduling_latency_s":1.050811,"redis_calls":7,"redis_duration_s":0.0020039999999999997,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00057,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025249,"completed_at":"2026-08-20T08:21:04.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 292.636907] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5cbc5033854245ed793c6b42","created_at":"2026-08-20T08:21:03.416Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"feff19b093090da7a1a603c57e7b8038","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:21:03.423Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5cbc5033854245ed793c6b42: start","job_status":"start","queue_duration_s":1.026717,"scheduling_latency_s":1.026734}1460gitlab # [ 292.650336] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.459Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1461gitlab # [ 292.653981] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5cbc5033854245ed793c6b42","created_at":"2026-08-20T08:21:03.416Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"feff19b093090da7a1a603c57e7b8038","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:21:03.423Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5cbc5033854245ed793c6b42: done: 0.014278 sec","job_status":"done","queue_duration_s":1.026717,"scheduling_latency_s":1.026734,"redis_calls":7,"redis_duration_s":0.001686,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014278,"completed_at":"2026-08-20T08:21:04.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 292.693649] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.469Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bd74944051af1435307e7cd5","created_at":"2026-08-20T08:21:03.457Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"626d2d9768955dac422a73b37038e094","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.470Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bd74944051af1435307e7cd5: start","job_status":"start","queue_duration_s":0.998631,"scheduling_latency_s":0.99865}1463gitlab # [ 292.976259] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bd74944051af1435307e7cd5","created_at":"2026-08-20T08:21:03.457Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-1372983687d5401b","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"626d2d9768955dac422a73b37038e094","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.470Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bd74944051af1435307e7cd5: done: 0.393809 sec","job_status":"done","queue_duration_s":0.998631,"scheduling_latency_s":0.99865,"redis_calls":562,"redis_duration_s":0.10144,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.100096,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.336841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.393809,"completed_at":"2026-08-20T08:21:04.862Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 293.065171] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.864Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"187704d065acaf42d776c45f","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-187704d065acaf42d776c45f: start","job_status":"start","queue_duration_s":1.125364,"scheduling_latency_s":1.125388}1465gitlab # [ 293.080928] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.879Z","message":"No existing merge request to be cleaned up."}1466gitlab # [ 293.082830] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.889Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"187704d065acaf42d776c45f","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-187704d065acaf42d776c45f: done: 0.024181 sec","job_status":"done","queue_duration_s":1.125364,"scheduling_latency_s":1.125388,"redis_calls":10,"redis_duration_s":0.0031609999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002034,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024181,"completed_at":"2026-08-20T08:21:04.888Z","load_balancing_strategy":"primary","db_duration_s":0.003422,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 293.123837] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.890Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d0a357de689c1eab2a5ff83f","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d0a357de689c1eab2a5ff83f: start","job_status":"start","queue_duration_s":1.151026,"scheduling_latency_s":1.151364}1468gitlab # [ 293.136816] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.902Z","message":"No existing merge request to be cleaned up."}1469gitlab # [ 293.138472] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.912Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d0a357de689c1eab2a5ff83f","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d0a357de689c1eab2a5ff83f: done: 0.022298 sec","job_status":"done","queue_duration_s":1.151026,"scheduling_latency_s":1.151364,"redis_calls":10,"redis_duration_s":0.003136,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001531,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022298,"completed_at":"2026-08-20T08:21:04.912Z","load_balancing_strategy":"primary","db_duration_s":0.002853,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 293.179163] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.914Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"646ab10fa615eae7a974f8dc","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-646ab10fa615eae7a974f8dc: start","job_status":"start","queue_duration_s":1.174879,"scheduling_latency_s":1.174895}1471gitlab # [ 293.191686] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.925Z","message":"No existing merge request to be cleaned up."}1472gitlab # [ 293.193449] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.934Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"646ab10fa615eae7a974f8dc","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-646ab10fa615eae7a974f8dc: done: 0.020351 sec","job_status":"done","queue_duration_s":1.174879,"scheduling_latency_s":1.174895,"redis_calls":10,"redis_duration_s":0.0026379999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001511,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020351,"completed_at":"2026-08-20T08:21:04.934Z","load_balancing_strategy":"primary","db_duration_s":0.002867,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 293.233058] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.936Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8c89ff898600f54af607551c","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8c89ff898600f54af607551c: start","job_status":"start","queue_duration_s":1.196747,"scheduling_latency_s":1.196763}1474gitlab # [ 293.245673] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.947Z","message":"No existing merge request to be cleaned up."}1475gitlab # [ 293.247346] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.956Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8c89ff898600f54af607551c","created_at":"2026-08-20T08:21:03.726Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-cfc1116708f04bba","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b2c7176c8f9355514a439873a9172100","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:03.739Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8c89ff898600f54af607551c: done: 0.02023 sec","job_status":"done","queue_duration_s":1.196747,"scheduling_latency_s":1.196763,"redis_calls":10,"redis_duration_s":0.002647,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001531,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02023,"completed_at":"2026-08-20T08:21:04.956Z","load_balancing_strategy":"primary","db_duration_s":0.002673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 293.286935] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a0d949c8a6cd41385603880","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a0d949c8a6cd41385603880: start","job_status":"start","queue_duration_s":0.755606,"scheduling_latency_s":0.755623}1477gitlab # [ 293.299792] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a0d949c8a6cd41385603880","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a0d949c8a6cd41385603880: done: 0.016165 sec","job_status":"done","queue_duration_s":0.755606,"scheduling_latency_s":0.755623,"redis_calls":13,"redis_duration_s":0.002927,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016165,"completed_at":"2026-08-20T08:21:04.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 293.339973] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814909124ed67e82e74255a6","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814909124ed67e82e74255a6: start","job_status":"start","queue_duration_s":0.773945,"scheduling_latency_s":0.773962}1479gitlab # [ 293.352936] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814909124ed67e82e74255a6","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814909124ed67e82e74255a6: done: 0.015917 sec","job_status":"done","queue_duration_s":0.773945,"scheduling_latency_s":0.773962,"redis_calls":13,"redis_duration_s":0.002738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001752,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015917,"completed_at":"2026-08-20T08:21:04.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 293.393604] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:04.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2526d1125d5a79912e590fc7","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2526d1125d5a79912e590fc7: start","job_status":"start","queue_duration_s":0.791305,"scheduling_latency_s":0.79132}1481gitlab # [ 293.406270] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2526d1125d5a79912e590fc7","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2526d1125d5a79912e590fc7: done: 0.015305 sec","job_status":"done","queue_duration_s":0.791305,"scheduling_latency_s":0.79132,"redis_calls":13,"redis_duration_s":0.002878,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015305,"completed_at":"2026-08-20T08:21:05.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 293.446027] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ec3a23280651ff31d3259a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ec3a23280651ff31d3259a: start","job_status":"start","queue_duration_s":0.808101,"scheduling_latency_s":0.808115}1483gitlab # [ 293.458802] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ec3a23280651ff31d3259a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ec3a23280651ff31d3259a: done: 0.015021 sec","job_status":"done","queue_duration_s":0.808101,"scheduling_latency_s":0.808115,"redis_calls":13,"redis_duration_s":0.002758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015021,"completed_at":"2026-08-20T08:21:05.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 293.499086] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1dba5ea30e2928af0cc6168","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1dba5ea30e2928af0cc6168: start","job_status":"start","queue_duration_s":0.824635,"scheduling_latency_s":0.824649}1485gitlab # [ 293.511739] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1dba5ea30e2928af0cc6168","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1dba5ea30e2928af0cc6168: done: 0.015022 sec","job_status":"done","queue_duration_s":0.824635,"scheduling_latency_s":0.824649,"redis_calls":13,"redis_duration_s":0.00287,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015022,"completed_at":"2026-08-20T08:21:05.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 293.552342] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e138f555e39a037bafc7c94c","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e138f555e39a037bafc7c94c: start","job_status":"start","queue_duration_s":0.841057,"scheduling_latency_s":0.841071}1487gitlab # [ 293.564743] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e138f555e39a037bafc7c94c","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e138f555e39a037bafc7c94c: done: 0.014923 sec","job_status":"done","queue_duration_s":0.841057,"scheduling_latency_s":0.841071,"redis_calls":13,"redis_duration_s":0.002687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014923,"completed_at":"2026-08-20T08:21:05.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 293.605639] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cf588e9429b1d87e050a82e","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cf588e9429b1d87e050a82e: start","job_status":"start","queue_duration_s":0.857407,"scheduling_latency_s":0.857422}1489gitlab # [ 293.618372] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cf588e9429b1d87e050a82e","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cf588e9429b1d87e050a82e: done: 0.01532 sec","job_status":"done","queue_duration_s":0.857407,"scheduling_latency_s":0.857422,"redis_calls":13,"redis_duration_s":0.002921,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01532,"completed_at":"2026-08-20T08:21:05.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 293.658338] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55c93403c9e97a9c0ed06d04","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55c93403c9e97a9c0ed06d04: start","job_status":"start","queue_duration_s":0.874656,"scheduling_latency_s":0.874673}1491gitlab # [ 293.671068] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55c93403c9e97a9c0ed06d04","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55c93403c9e97a9c0ed06d04: done: 0.015415 sec","job_status":"done","queue_duration_s":0.874656,"scheduling_latency_s":0.874673,"redis_calls":13,"redis_duration_s":0.002974,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015415,"completed_at":"2026-08-20T08:21:05.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 293.711808] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9664bfaf8bccfedf38702156","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9664bfaf8bccfedf38702156: start","job_status":"start","queue_duration_s":0.891473,"scheduling_latency_s":0.891488}1493gitlab # [ 293.725050] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9664bfaf8bccfedf38702156","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9664bfaf8bccfedf38702156: done: 0.014424 sec","job_status":"done","queue_duration_s":0.891473,"scheduling_latency_s":0.891488,"redis_calls":13,"redis_duration_s":0.001898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014424,"completed_at":"2026-08-20T08:21:05.108Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 293.765453] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf085a32ad6803f395fc5684","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf085a32ad6803f395fc5684: start","job_status":"start","queue_duration_s":0.907065,"scheduling_latency_s":0.907081}1495gitlab # [ 293.778114] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf085a32ad6803f395fc5684","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf085a32ad6803f395fc5684: done: 0.01434 sec","job_status":"done","queue_duration_s":0.907065,"scheduling_latency_s":0.907081,"redis_calls":13,"redis_duration_s":0.001525,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01434,"completed_at":"2026-08-20T08:21:05.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 293.820179] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e786307c8509e6529ce46fa","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e786307c8509e6529ce46fa: start","job_status":"start","queue_duration_s":0.92272,"scheduling_latency_s":0.922735}1497gitlab # [ 293.832741] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e786307c8509e6529ce46fa","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e786307c8509e6529ce46fa: done: 0.014343 sec","job_status":"done","queue_duration_s":0.92272,"scheduling_latency_s":0.922735,"redis_calls":13,"redis_duration_s":0.001537,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014343,"completed_at":"2026-08-20T08:21:05.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 293.872403] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d951e0a92971aba6a397298d","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d951e0a92971aba6a397298d: start","job_status":"start","queue_duration_s":0.938161,"scheduling_latency_s":0.938176}1499gitlab # [ 293.884970] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d951e0a92971aba6a397298d","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d951e0a92971aba6a397298d: done: 0.014371 sec","job_status":"done","queue_duration_s":0.938161,"scheduling_latency_s":0.938176,"redis_calls":13,"redis_duration_s":0.001563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014371,"completed_at":"2026-08-20T08:21:05.154Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 293.924951] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c7e74e31e433052f635fe8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c7e74e31e433052f635fe8: start","job_status":"start","queue_duration_s":0.953602,"scheduling_latency_s":0.953617}1501gitlab # [ 293.937553] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85c7e74e31e433052f635fe8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85c7e74e31e433052f635fe8: done: 0.01423 sec","job_status":"done","queue_duration_s":0.953602,"scheduling_latency_s":0.953617,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01423,"completed_at":"2026-08-20T08:21:05.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 293.977642] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe9210bfff129ec22f573c7c","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe9210bfff129ec22f573c7c: start","job_status":"start","queue_duration_s":0.968924,"scheduling_latency_s":0.968939}1503gitlab # [ 293.991658] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe9210bfff129ec22f573c7c","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe9210bfff129ec22f573c7c: done: 0.014649 sec","job_status":"done","queue_duration_s":0.968924,"scheduling_latency_s":0.968939,"redis_calls":13,"redis_duration_s":0.001782,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014649,"completed_at":"2026-08-20T08:21:05.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 294.031625] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3d24a57566c676da0ef83d8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3d24a57566c676da0ef83d8: start","job_status":"start","queue_duration_s":0.984862,"scheduling_latency_s":0.984878}1505gitlab # [ 294.044565] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3d24a57566c676da0ef83d8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3d24a57566c676da0ef83d8: done: 0.014176 sec","job_status":"done","queue_duration_s":0.984862,"scheduling_latency_s":0.984878,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014176,"completed_at":"2026-08-20T08:21:05.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 294.084328] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f23689aaf383a1c998de697","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f23689aaf383a1c998de697: start","job_status":"start","queue_duration_s":1.000195,"scheduling_latency_s":1.00021}1507gitlab # [ 294.096807] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f23689aaf383a1c998de697","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f23689aaf383a1c998de697: done: 0.014125 sec","job_status":"done","queue_duration_s":1.000195,"scheduling_latency_s":1.00021,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014125,"completed_at":"2026-08-20T08:21:05.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 294.136302] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578afaa8c9282924fc47f47d","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578afaa8c9282924fc47f47d: start","job_status":"start","queue_duration_s":1.015398,"scheduling_latency_s":1.015413}1509gitlab # [ 294.148791] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578afaa8c9282924fc47f47d","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578afaa8c9282924fc47f47d: done: 0.014065 sec","job_status":"done","queue_duration_s":1.015398,"scheduling_latency_s":1.015413,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014065,"completed_at":"2026-08-20T08:21:05.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 294.188338] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ed00052f9fdb1d10e93e763","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ed00052f9fdb1d10e93e763: start","job_status":"start","queue_duration_s":1.030595,"scheduling_latency_s":1.030611}1511gitlab # [ 294.201889] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ed00052f9fdb1d10e93e763","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ed00052f9fdb1d10e93e763: done: 0.014102 sec","job_status":"done","queue_duration_s":1.030595,"scheduling_latency_s":1.030611,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014102,"completed_at":"2026-08-20T08:21:05.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 294.241265] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d5c0736ebb4de4a52342bd6","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d5c0736ebb4de4a52342bd6: start","job_status":"start","queue_duration_s":1.045787,"scheduling_latency_s":1.045802}1513gitlab # [ 294.253971] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d5c0736ebb4de4a52342bd6","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d5c0736ebb4de4a52342bd6: done: 0.014354 sec","job_status":"done","queue_duration_s":1.045787,"scheduling_latency_s":1.045802,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014354,"completed_at":"2026-08-20T08:21:05.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 294.293329] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b183c78e427e465cfc7eb54b","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b183c78e427e465cfc7eb54b: start","job_status":"start","queue_duration_s":1.061309,"scheduling_latency_s":1.061324}1515gitlab # [ 294.305782] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b183c78e427e465cfc7eb54b","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b183c78e427e465cfc7eb54b: done: 0.01431 sec","job_status":"done","queue_duration_s":1.061309,"scheduling_latency_s":1.061324,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01431,"completed_at":"2026-08-20T08:21:05.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 294.344975] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6823233eec0ec3fa202fb03","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6823233eec0ec3fa202fb03: start","job_status":"start","queue_duration_s":1.076962,"scheduling_latency_s":1.076978}1517gitlab # [ 294.357344] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6823233eec0ec3fa202fb03","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6823233eec0ec3fa202fb03: done: 0.014313 sec","job_status":"done","queue_duration_s":1.076962,"scheduling_latency_s":1.076978,"redis_calls":13,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014313,"completed_at":"2026-08-20T08:21:05.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 294.397509] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9107ae9e943b5648fc3e2b24","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9107ae9e943b5648fc3e2b24: start","job_status":"start","queue_duration_s":1.092345,"scheduling_latency_s":1.092359}1519gitlab # [ 294.409974] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9107ae9e943b5648fc3e2b24","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9107ae9e943b5648fc3e2b24: done: 0.014403 sec","job_status":"done","queue_duration_s":1.092345,"scheduling_latency_s":1.092359,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014403,"completed_at":"2026-08-20T08:21:05.309Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 294.449148] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e04d317c06403c9467635f18","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e04d317c06403c9467635f18: start","job_status":"start","queue_duration_s":1.107826,"scheduling_latency_s":1.107842}1521gitlab # [ 294.461592] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e04d317c06403c9467635f18","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e04d317c06403c9467635f18: done: 0.014527 sec","job_status":"done","queue_duration_s":1.107826,"scheduling_latency_s":1.107842,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014527,"completed_at":"2026-08-20T08:21:05.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 294.500539] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a9c37225276542b5c459dbf","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a9c37225276542b5c459dbf: start","job_status":"start","queue_duration_s":1.123744,"scheduling_latency_s":1.12376}1523gitlab # [ 294.512880] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a9c37225276542b5c459dbf","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a9c37225276542b5c459dbf: done: 0.014315 sec","job_status":"done","queue_duration_s":1.123744,"scheduling_latency_s":1.12376,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014315,"completed_at":"2026-08-20T08:21:05.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 294.552255] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e800fd01f007d766d198585b","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e800fd01f007d766d198585b: start","job_status":"start","queue_duration_s":1.139235,"scheduling_latency_s":1.139251}1525gitlab # [ 294.564656] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e800fd01f007d766d198585b","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e800fd01f007d766d198585b: done: 0.014715 sec","job_status":"done","queue_duration_s":1.139235,"scheduling_latency_s":1.139251,"redis_calls":13,"redis_duration_s":0.001489,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014715,"completed_at":"2026-08-20T08:21:05.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 294.605530] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48aec3d40d5f5b350d255e5a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48aec3d40d5f5b350d255e5a: start","job_status":"start","queue_duration_s":1.155162,"scheduling_latency_s":1.155177}1527gitlab # [ 294.618095] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48aec3d40d5f5b350d255e5a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48aec3d40d5f5b350d255e5a: done: 0.01483 sec","job_status":"done","queue_duration_s":1.155162,"scheduling_latency_s":1.155177,"redis_calls":13,"redis_duration_s":0.0015739999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01483,"completed_at":"2026-08-20T08:21:05.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 294.657509] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.373Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"407483dc8ae193e5bc519ff2","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-407483dc8ae193e5bc519ff2: start","job_status":"start","queue_duration_s":1.17153,"scheduling_latency_s":1.171547}1529gitlab # [ 294.669960] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"407483dc8ae193e5bc519ff2","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-407483dc8ae193e5bc519ff2: done: 0.0152 sec","job_status":"done","queue_duration_s":1.17153,"scheduling_latency_s":1.171547,"redis_calls":13,"redis_duration_s":0.001814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001228,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0152,"completed_at":"2026-08-20T08:21:05.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 294.708788] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92df2935fff9618f542abacb","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92df2935fff9618f542abacb: start","job_status":"start","queue_duration_s":1.187816,"scheduling_latency_s":1.18783}1531gitlab # [ 294.721095] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92df2935fff9618f542abacb","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92df2935fff9618f542abacb: done: 0.015169 sec","job_status":"done","queue_duration_s":1.187816,"scheduling_latency_s":1.18783,"redis_calls":14,"redis_duration_s":0.001643,"redis_read_bytes":44,"redis_write_bytes":1192,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000117,"redis_feature_flag_read_bytes":34,"redis_feature_flag_write_bytes":35,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015169,"completed_at":"2026-08-20T08:21:05.405Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 294.762748] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fb6bfb5a98b6d6dc540b5b2","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fb6bfb5a98b6d6dc540b5b2: start","job_status":"start","queue_duration_s":1.204092,"scheduling_latency_s":1.204108}1533gitlab # [ 294.775805] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fb6bfb5a98b6d6dc540b5b2","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fb6bfb5a98b6d6dc540b5b2: done: 0.014634 sec","job_status":"done","queue_duration_s":1.204092,"scheduling_latency_s":1.204108,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014634,"completed_at":"2026-08-20T08:21:05.421Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 294.817201] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd16c50d122c7a4d05a8f1b1","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd16c50d122c7a4d05a8f1b1: start","job_status":"start","queue_duration_s":1.219854,"scheduling_latency_s":1.21987}1535gitlab # [ 294.829795] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd16c50d122c7a4d05a8f1b1","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd16c50d122c7a4d05a8f1b1: done: 0.014872 sec","job_status":"done","queue_duration_s":1.219854,"scheduling_latency_s":1.21987,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014872,"completed_at":"2026-08-20T08:21:05.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 294.869237] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"904786ab55b300b7fcb6c158","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-904786ab55b300b7fcb6c158: start","job_status":"start","queue_duration_s":1.235897,"scheduling_latency_s":1.235913}1537gitlab # [ 294.881656] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"904786ab55b300b7fcb6c158","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-904786ab55b300b7fcb6c158: done: 0.014692 sec","job_status":"done","queue_duration_s":1.235897,"scheduling_latency_s":1.235913,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014692,"completed_at":"2026-08-20T08:21:05.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 294.920621] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e71f4788eb8956fb60e22caf","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e71f4788eb8956fb60e22caf: start","job_status":"start","queue_duration_s":1.251666,"scheduling_latency_s":1.251682}1539gitlab # [ 294.932633] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e71f4788eb8956fb60e22caf","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e71f4788eb8956fb60e22caf: done: 0.014872 sec","job_status":"done","queue_duration_s":1.251666,"scheduling_latency_s":1.251682,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000603,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014872,"completed_at":"2026-08-20T08:21:05.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 294.971719] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2309dac5326a4d08e561207a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2309dac5326a4d08e561207a: start","job_status":"start","queue_duration_s":1.267612,"scheduling_latency_s":1.267627}1541gitlab # [ 294.984621] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2309dac5326a4d08e561207a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2309dac5326a4d08e561207a: done: 0.015143 sec","job_status":"done","queue_duration_s":1.267612,"scheduling_latency_s":1.267627,"redis_calls":13,"redis_duration_s":0.0020109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015143,"completed_at":"2026-08-20T08:21:05.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 295.024779] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee164bf4809f99cf6e51c3f8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee164bf4809f99cf6e51c3f8: start","job_status":"start","queue_duration_s":1.283859,"scheduling_latency_s":1.283874}1543gitlab # [ 295.037467] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee164bf4809f99cf6e51c3f8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee164bf4809f99cf6e51c3f8: done: 0.014654 sec","job_status":"done","queue_duration_s":1.283859,"scheduling_latency_s":1.283874,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014654,"completed_at":"2026-08-20T08:21:05.500Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 295.076863] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebcc76048ec65e10a6deec0a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebcc76048ec65e10a6deec0a: start","job_status":"start","queue_duration_s":1.299671,"scheduling_latency_s":1.299687}1545gitlab # [ 295.089520] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebcc76048ec65e10a6deec0a","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebcc76048ec65e10a6deec0a: done: 0.014548 sec","job_status":"done","queue_duration_s":1.299671,"scheduling_latency_s":1.299687,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014548,"completed_at":"2026-08-20T08:21:05.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 295.129028] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"878e59d9481770fad366d866","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-878e59d9481770fad366d866: start","job_status":"start","queue_duration_s":1.315617,"scheduling_latency_s":1.315635}1547gitlab # [ 295.141535] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"878e59d9481770fad366d866","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-878e59d9481770fad366d866: done: 0.015323 sec","job_status":"done","queue_duration_s":1.315617,"scheduling_latency_s":1.315635,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015323,"completed_at":"2026-08-20T08:21:05.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 295.180932] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85e5809b8f0a11c8ee92cc65","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85e5809b8f0a11c8ee92cc65: start","job_status":"start","queue_duration_s":1.331753,"scheduling_latency_s":1.331768}1549gitlab # [ 295.193355] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85e5809b8f0a11c8ee92cc65","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85e5809b8f0a11c8ee92cc65: done: 0.015536 sec","job_status":"done","queue_duration_s":1.331753,"scheduling_latency_s":1.331768,"redis_calls":13,"redis_duration_s":0.002103,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015536,"completed_at":"2026-08-20T08:21:05.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 295.233599] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42a43c9f945f9c839d7b360","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42a43c9f945f9c839d7b360: start","job_status":"start","queue_duration_s":1.348411,"scheduling_latency_s":1.348427}1551gitlab # [ 295.246000] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b42a43c9f945f9c839d7b360","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b42a43c9f945f9c839d7b360: done: 0.016424 sec","job_status":"done","queue_duration_s":1.348411,"scheduling_latency_s":1.348427,"redis_calls":13,"redis_duration_s":0.002076,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001528,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016424,"completed_at":"2026-08-20T08:21:05.567Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 295.284833] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de04d3c45314a49cadc51cc1","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de04d3c45314a49cadc51cc1: start","job_status":"start","queue_duration_s":1.365975,"scheduling_latency_s":1.365992}1553gitlab # [ 295.297111] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de04d3c45314a49cadc51cc1","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de04d3c45314a49cadc51cc1: done: 0.017374 sec","job_status":"done","queue_duration_s":1.365975,"scheduling_latency_s":1.365992,"redis_calls":13,"redis_duration_s":0.00182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017374,"completed_at":"2026-08-20T08:21:05.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 295.336243] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07b6d6b239fcfddfbccc7e8f","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07b6d6b239fcfddfbccc7e8f: start","job_status":"start","queue_duration_s":1.384617,"scheduling_latency_s":1.384634}1555gitlab # [ 295.348501] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07b6d6b239fcfddfbccc7e8f","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07b6d6b239fcfddfbccc7e8f: done: 0.017957 sec","job_status":"done","queue_duration_s":1.384617,"scheduling_latency_s":1.384634,"redis_calls":13,"redis_duration_s":0.0016060000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017957,"completed_at":"2026-08-20T08:21:05.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 295.387870] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12a5e7f27f38cbbb1e3858c3","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12a5e7f27f38cbbb1e3858c3: start","job_status":"start","queue_duration_s":1.403675,"scheduling_latency_s":1.40369}1557gitlab # [ 295.400490] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12a5e7f27f38cbbb1e3858c3","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12a5e7f27f38cbbb1e3858c3: done: 0.016511 sec","job_status":"done","queue_duration_s":1.403675,"scheduling_latency_s":1.40369,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016511,"completed_at":"2026-08-20T08:21:05.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 295.440492] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f46496b08ac289dbfc9d61","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f46496b08ac289dbfc9d61: start","job_status":"start","queue_duration_s":1.421899,"scheduling_latency_s":1.421915}1559gitlab # [ 295.452766] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1f46496b08ac289dbfc9d61","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1f46496b08ac289dbfc9d61: done: 0.016349 sec","job_status":"done","queue_duration_s":1.421899,"scheduling_latency_s":1.421915,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016349,"completed_at":"2026-08-20T08:21:05.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 295.491675] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0336eb2cbf3c0f30ebfe8079","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0336eb2cbf3c0f30ebfe8079: start","job_status":"start","queue_duration_s":1.440044,"scheduling_latency_s":1.440061}1561gitlab # [ 295.504242] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0336eb2cbf3c0f30ebfe8079","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0336eb2cbf3c0f30ebfe8079: done: 0.016038 sec","job_status":"done","queue_duration_s":1.440044,"scheduling_latency_s":1.440061,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016038,"completed_at":"2026-08-20T08:21:05.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 295.542993] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8531282c0d0a0304c6d0f5ea","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8531282c0d0a0304c6d0f5ea: start","job_status":"start","queue_duration_s":1.457837,"scheduling_latency_s":1.457853}1563gitlab # [ 295.555507] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8531282c0d0a0304c6d0f5ea","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8531282c0d0a0304c6d0f5ea: done: 0.016226 sec","job_status":"done","queue_duration_s":1.457837,"scheduling_latency_s":1.457853,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016226,"completed_at":"2026-08-20T08:21:05.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 295.594603] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cc66a1c6458389e3bef6b93","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cc66a1c6458389e3bef6b93: start","job_status":"start","queue_duration_s":1.475799,"scheduling_latency_s":1.475816}1565gitlab # [ 295.607124] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0cc66a1c6458389e3bef6b93","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0cc66a1c6458389e3bef6b93: done: 0.016853 sec","job_status":"done","queue_duration_s":1.475799,"scheduling_latency_s":1.475816,"redis_calls":13,"redis_duration_s":0.0016179999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000614,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016853,"completed_at":"2026-08-20T08:21:05.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 295.647995] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24561cc8a4c68bab96052861","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24561cc8a4c68bab96052861: start","job_status":"start","queue_duration_s":1.493759,"scheduling_latency_s":1.493774}1567gitlab # [ 295.660298] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24561cc8a4c68bab96052861","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24561cc8a4c68bab96052861: done: 0.013944 sec","job_status":"done","queue_duration_s":1.493759,"scheduling_latency_s":1.493774,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013944,"completed_at":"2026-08-20T08:21:05.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568gitlab # [ 295.699722] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955481f4a2666304a63fd4a8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955481f4a2666304a63fd4a8: start","job_status":"start","queue_duration_s":1.508802,"scheduling_latency_s":1.508816}1569gitlab # [ 295.712461] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955481f4a2666304a63fd4a8","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955481f4a2666304a63fd4a8: done: 0.013976 sec","job_status":"done","queue_duration_s":1.508802,"scheduling_latency_s":1.508816,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013976,"completed_at":"2026-08-20T08:21:05.725Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570gitlab # [ 295.753233] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0097f3d792b9ce4737bdc1ff","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0097f3d792b9ce4737bdc1ff: start","job_status":"start","queue_duration_s":1.523862,"scheduling_latency_s":1.523877}1571gitlab # [ 295.765928] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0097f3d792b9ce4737bdc1ff","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0097f3d792b9ce4737bdc1ff: done: 0.014028 sec","job_status":"done","queue_duration_s":1.523862,"scheduling_latency_s":1.523877,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014028,"completed_at":"2026-08-20T08:21:05.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572gitlab # [ 295.806573] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf29fcf090a41a9442e09e69","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf29fcf090a41a9442e09e69: start","job_status":"start","queue_duration_s":1.539048,"scheduling_latency_s":1.539066}1573gitlab # [ 295.819594] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf29fcf090a41a9442e09e69","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf29fcf090a41a9442e09e69: done: 0.014839 sec","job_status":"done","queue_duration_s":1.539048,"scheduling_latency_s":1.539066,"redis_calls":13,"redis_duration_s":0.001633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014839,"completed_at":"2026-08-20T08:21:05.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574gitlab # [ 295.861603] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d643489d15b56740134c837","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d643489d15b56740134c837: start","job_status":"start","queue_duration_s":1.555156,"scheduling_latency_s":1.555172}1575gitlab # [ 295.899487] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:05.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d643489d15b56740134c837","created_at":"2026-08-20T08:21:04.114Z","trace_propagation_headers":{"sentry-trace":"e95d7557073f4e15822c723d97f6bcf1-0cb1ede12efd4815","baggage":"sentry-trace_id=e95d7557073f4e15822c723d97f6bcf1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d2e8b3f2eddca162138bbb3a550e4aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:04.202Z","job_size_bytes":2,"pid":2022,"sidekiq_tid":"maoq","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d643489d15b56740134c837: done: 0.014434 sec","job_status":"done","queue_duration_s":1.555156,"scheduling_latency_s":1.555172,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014434,"completed_at":"2026-08-20T08:21:05.771Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576gitlab # [ 308.191760] redis[797]: 10 changes in 300 seconds. Saving...1577gitlab # [ 308.195638] redis[797]: Background saving started by pid 33001578gitlab # [ 308.203406] redis[3300]: BGSAVE done, 523 keys saved, 0 keys skipped, 130209 bytes written.1579gitlab # [ 308.209286] redis[3300]: DB saved on disk1580gitlab # [ 308.210858] redis[3300]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1581gitlab # [ 308.293252] redis[797]: Background saving terminated with success1582gitlab # [ 309.416550] postgres[866]: [866] LOG: checkpoint starting: time1583gitlab # [ 311.272605] gitaly[910]: time="2026-08-20T08:21:23.159Z" level=info msg="burden monitor stats" pid=9101584gitlab # [ 315.542476] postgres[3314]: [3314] ERROR: relation "table_without_models" does not exist1585gitlab # [ 315.542855] postgres[3314]: [3314] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1586gitlab # [ 322.081767] runuser[2964]: pam_unix(runuser:session): session closed for user gitlab1587gitlab # [ 322.083588] setup-gitlab-start[2934]: + systemctl restart gitlab-sidekiq.service1588gitlab # [ 322.128844] systemd[1]: Stopping gitlab-sidekiq.service...1589gitlab # [ 322.130574] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:34.016Z","message":"Shutting down"}1590gitlab # [ 322.132832] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:34.017Z","message":"Scheduler exiting..."}1591gitlab # [ 322.134792] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:34.017Z","message":"Terminating quiet threads for default capsule"}1592gitlab # [ 322.137189] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:34.018Z","message":"Scheduler exiting..."}1593gitlab # [ 322.631174] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:34.519Z","message":"Pausing to allow jobs to finish..."}1594gitlab # [ 324.135446] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:36.022Z","message":"Bye!"}1595gitlab # [ 324.176713] sidekiq-cluster[2022]: {"severity":"INFO","time":"2026-08-20T08:21:36.064Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2022,"worker_id":"sidekiq_0","memwd_rss_bytes":929517568,"retry":0}1596gitlab # [ 326.380818] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1597gitlab # [ 326.381232] systemd[1]: Stopped gitlab-sidekiq.service.1598gitlab # [ 326.381463] systemd[1]: gitlab-sidekiq.service: Consumed 1min 49.595s CPU time over 3min 25.237s wall clock time, 939.6M memory peak, 4.8M read from disk.1599gitlab # [ 326.395053] systemd[1]: Started gitlab-sidekiq.service.1600gitlab # [ 326.398557] setup-gitlab-start[2934]: + mkdir -p /var/lib/secrets1601gitlab # [ 326.403643] setup-gitlab-start[2934]: + echo nixbot-test-token-of-20-chars1602gitlab # [ 326.406812] setup-gitlab-start[2934]: + chmod 644 /var/lib/secrets/gitlab-token1603gitlab # [ 326.409943] setup-gitlab-start[2934]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1604gitlab # [ 327.629106] gitaly[910]: time="2026-08-20T08:21:39.516Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.515" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 327.636215] gitaly[910]: time="2026-08-20T08:21:39.518Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.515" grpc.time_ms=2.842 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 327.811476] gitaly[910]: time="2026-08-20T08:21:39.699Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.188" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.699" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 327.874937] gitaly[910]: time="2026-08-20T08:21:39.700Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.188" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.699" grpc.time_ms=0.606 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1608gitlab # [ 327.909452] gitaly[910]: time="2026-08-20T08:21:39.774Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG diskcache=6f6e097d-2b24-41ab-9f5f-cf60c14dcb2d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:21:49.203" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.714" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1609gitlab # [ 327.932168] gitaly[910]: time="2026-08-20T08:21:39.775Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=37 command.spawn_token_fork_ms=4 command.system_time_ms=24 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:21:49.203" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.714" grpc.time_ms=61.194 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1610gitlab # [ 327.954711] gitaly[910]: time="2026-08-20T08:21:39.797Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.285" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.796" pid=910 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1611gitlab # [ 327.971657] gitaly[910]: time="2026-08-20T08:21:39.797Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.285" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.796" grpc.time_ms=1.197 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 327.987720] gitaly[910]: time="2026-08-20T08:21:39.822Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:21:49.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.805" grpc.time_ms=16.197 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 328.044712] gitaly[910]: time="2026-08-20T08:21:39.933Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.131" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.932" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 328.057197] gitaly[910]: time="2026-08-20T08:21:39.933Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:49.131" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.932" grpc.time_ms=0.831 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 328.107225] gitaly[910]: time="2026-08-20T08:21:39.995Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG diskcache=6b836306-5762-4d99-a6cd-b582e7eaed7d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:21:49.136" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.937" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 328.125424] gitaly[910]: time="2026-08-20T08:21:39.995Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=37 command.spawn_token_fork_ms=7 command.system_time_ms=25 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T08:21:49.136" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:39.937" grpc.time_ms=58.536 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 328.144706] gitaly[910]: time="2026-08-20T08:21:40.007Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:50.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:40.005" pid=910 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1618gitlab # [ 328.157296] gitaly[910]: time="2026-08-20T08:21:40.007Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:50.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:40.005" grpc.time_ms=1.462 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 328.169504] gitaly[910]: time="2026-08-20T08:21:40.028Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:21:50.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:40.015" grpc.time_ms=12.914 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 328.209006] gitaly[910]: time="2026-08-20T08:21:40.097Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:21:50.096" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:40.097" grpc.time_ms=0.178 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 328.235946] gitaly[910]: time="2026-08-20T08:21:40.115Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:21:50.114" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:40.114" grpc.time_ms=0.602 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 329.071525] gitaly[910]: time="2026-08-20T08:21:40.959Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0F45VWSP98NESHNPJCZG9EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:21:50.139" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:40.940" grpc.time_ms=18.18 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1623gitlab # [ 329.874630] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:41 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 34321624gitlab # [ 329.878798] setup-gitlab-start[2934]: + mkdir -p /tmp/test-flake1625gitlab # [ 329.883310] setup-gitlab-start[2934]: + cd /tmp/test-flake1626gitlab # [ 329.885806] setup-gitlab-start[2934]: + git init -b master1627gitlab # [ 329.910622] setup-gitlab-start[3433]: Initialized empty Git repository in /tmp/test-flake/.git/1628gitlab # [ 329.914468] setup-gitlab-start[2934]: + git config user.name test1629gitlab # [ 329.918648] setup-gitlab-start[2934]: + git config user.email test@example.com1630gitlab # [ 329.926007] setup-gitlab-start[2934]: + cat1631gitlab # [ 329.931736] setup-gitlab-start[2934]: + git add flake.nix1632gitlab # [ 329.940643] setup-gitlab-start[2934]: + git commit -m 'initial commit'1633gitlab # [ 329.963147] setup-gitlab-start[3438]: [master (root-commit) 661aba8] initial commit1634gitlab # [ 329.967461] setup-gitlab-start[3438]: 1 file changed, 10 insertions(+)1635gitlab # [ 329.970475] setup-gitlab-start[3438]: create mode 100644 flake.nix1636gitlab # [ 329.973142] setup-gitlab-start[2934]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1637gitlab # [ 329.979134] setup-gitlab-start[2934]: + git push -u origin master1638gitlab # [ 330.105126] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:41 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 801639gitlab # [ 331.092097] gitaly[910]: time="2026-08-20T08:21:42.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F45ZFBH35N513XDBAWA3WV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:42.958" grpc.time_ms=20.912 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1640gitlab # [ 331.106530] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:42 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 9861641gitlab # [ 331.533752] sidekiq-cluster[3381]: {"severity":"INFO","time":"2026-08-20T08:21:43.391Z","message":"Starting cluster with 1 processes"}1642gitlab # [ 331.576674] gitaly[910]: time="2026-08-20T08:21:43.464Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:21:53.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:43.449" grpc.time_ms=15.371 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1643gitlab # [ 331.699730] gitaly[910]: time="2026-08-20T08:21:43.587Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=7 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:22:13.066" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:21:43.567" grpc.time_ms=20.727 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1644gitlab # [ 331.749283] gitaly[910]: time="2026-08-20T08:21:43.637Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F460EWMJXEQCRDW6GAZ44X duration_ms=335ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/allowed"1645gitlab # [ 331.799757] gitaly[910]: time="2026-08-20T08:21:43.687Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F460EWMJXEQCRDW6GAZ44X duration_ms=49ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/pre_receive"1646gitlab # [ 331.809216] gitaly[910]: time="2026-08-20T08:21:43.688Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:43.299" grpc.time_ms=388.677 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1647gitlab # [ 331.846108] gitaly[910]: time="2026-08-20T08:21:43.734Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:43.732" grpc.time_ms=1.561 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1648gitlab # [ 331.889124] gitaly[910]: time="2026-08-20T08:21:43.777Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:43.775" grpc.time_ms=1.328 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1649gitlab # [ 331.927298] gitaly[910]: time="2026-08-20T08:21:43.815Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:43.814" grpc.time_ms=1.375 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1650gitlab # [ 332.107093] gitaly[910]: time="2026-08-20T08:21:43.994Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:21:53.175" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:43.976" grpc.time_ms=17.542 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1651gitlab # [ 332.164807] gitaly[910]: time="2026-08-20T08:21:44.053Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1431 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=9 command.system_time_ms=11 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:21:54.010" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:44.011" grpc.time_ms=41.159 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 332.202759] gitaly[910]: time="2026-08-20T08:21:44.074Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F460EWMJXEQCRDW6GAZ44X duration_ms=201ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/post_receive"1653gitlab # [ 332.210432] gitaly[910]: time="2026-08-20T08:21:44.075Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:43.871" grpc.time_ms=203.813 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1654gitlab # [ 332.232048] gitaly[910]: time="2026-08-20T08:21:44.096Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X diskcache=09aeed95-90fe-4e6f-84b7-77920227d2c3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:43.180" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1655gitlab # [ 332.250857] systemd[1]: Finished setup-gitlab.service.1656gitlab # [ 332.252550] gitlab-workhorse[825]: time="2026-08-20T08:21:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521657gitlab # [ 332.255399] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:44 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10931658gitlab # [ 332.258630] setup-gitlab-start[3442]: To http://gitlab/root/test-flake.git1659gitlab # [ 332.259924] setup-gitlab-start[3442]: * [new branch] master -> master1660gitlab # [ 332.261335] setup-gitlab-start[3442]: branch 'master' set up to track 'origin/master'.1661gitlab # [ 332.262786] gitaly[910]: time="2026-08-20T08:21:44.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=302 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=12947 command.oublock=32 command.real_time_ms=905 command.spawn_token_fork_ms=2 command.system_time_ms=203 command.user_time_ms=99 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:43.180" grpc.time_ms=916.574 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1662gitlab # [ 332.280446] systemd[1]: Starting nixbot CI service...1663gitlab: (finished: waiting for unit setup-gitlab.service, in 333.22 seconds)1664gitlab: waiting for unit nixbot.service1665gitlab # [ 333.493696] nixbot[3529]: {"ts": "2026-08-20T08:21:45.380Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1666gitlab # [ 333.533861] nixbot[3529]: {"ts": "2026-08-20T08:21:45.422Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1667gitlab # [ 333.575357] nixbot[3529]: {"ts": "2026-08-20T08:21:45.463Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1668gitlab # [ 333.583422] nixbot[3529]: {"ts": "2026-08-20T08:21:45.471Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1669gitlab # [ 333.591475] nixbot[3529]: {"ts": "2026-08-20T08:21:45.479Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1670gitlab # [ 333.603439] nixbot[3529]: {"ts": "2026-08-20T08:21:45.491Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1671gitlab # [ 333.610785] nixbot[3529]: {"ts": "2026-08-20T08:21:45.499Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1672gitlab # [ 333.617491] nixbot[3529]: {"ts": "2026-08-20T08:21:45.502Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1673gitlab # [ 333.625799] nixbot[3529]: {"ts": "2026-08-20T08:21:45.514Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1674gitlab # [ 333.632704] nixbot[3529]: {"ts": "2026-08-20T08:21:45.517Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1675gitlab # [ 333.639844] nixbot[3529]: {"ts": "2026-08-20T08:21:45.527Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1676gitlab # [ 333.651139] nixbot[3529]: {"ts": "2026-08-20T08:21:45.539Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1677gitlab # [ 333.658014] nixbot[3529]: {"ts": "2026-08-20T08:21:45.545Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1678gitlab # [ 333.664874] nixbot[3529]: {"ts": "2026-08-20T08:21:45.548Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1679gitlab # [ 333.671891] nixbot[3529]: {"ts": "2026-08-20T08:21:45.554Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1680gitlab # [ 333.679053] nixbot[3529]: {"ts": "2026-08-20T08:21:45.558Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1681gitlab # [ 333.685459] nixbot[3529]: {"ts": "2026-08-20T08:21:45.561Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1682gitlab # [ 333.691744] nixbot[3529]: {"ts": "2026-08-20T08:21:45.564Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1683gitlab # [ 333.697437] nixbot[3529]: {"ts": "2026-08-20T08:21:45.572Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1684gitlab # [ 333.703000] nixbot[3529]: {"ts": "2026-08-20T08:21:45.575Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1685gitlab # [ 333.708893] nixbot[3529]: {"ts": "2026-08-20T08:21:45.577Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1686gitlab # [ 333.714219] nixbot[3529]: {"ts": "2026-08-20T08:21:45.585Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1687gitlab # [ 333.719349] nixbot[3529]: {"ts": "2026-08-20T08:21:45.588Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1688gitlab # [ 333.724111] nixbot[3529]: {"ts": "2026-08-20T08:21:45.591Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1689gitlab # [ 333.728351] nixbot[3529]: {"ts": "2026-08-20T08:21:45.593Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1690gitlab # [ 334.227670] nixbot[3529]: INFO: Started server process [3529]1691gitlab # [ 334.230827] nixbot[3529]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1692gitlab # [ 334.276596] nixbot[3529]: INFO: ::ffff:127.0.0.1:49374 - "GET /health HTTP/1.1" 200 OK1693gitlab # [ 334.285114] systemd[1]: Started nixbot CI service.1694gitlab # [ 334.289245] systemd[1]: Reached target Multi-User System.1695gitlab # [ 334.292789] systemd[1]: Startup finished in 715ms (kernel) + 3.227s (initrd) + 5min 30.349s (userspace) = 5min 34.292s.1696gitlab # [ 334.713981] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:46 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4371697gitlab # [ 334.717009] nixbot[3529]: {"ts": "2026-08-20T08:21:46.604Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1698gitlab # [ 334.743296] nixbot[3529]: {"ts": "2026-08-20T08:21:46.631Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1699gitlab # [ 334.840112] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 801700gitlab # [ 334.846816] nixbot[3529]: {"ts": "2026-08-20T08:21:46.730Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1701gitlab # [ 334.854050] nixbot[3529]: {"ts": "2026-08-20T08:21:46.734Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1702gitlab: (finished: waiting for unit nixbot.service, in 2.12 seconds)1703gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1704gitlab # [ 334.928098] nixbot[3529]: INFO: ::ffff:127.0.0.1:49390 - "GET /health HTTP/1.1" 200 OK1705gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1706subtest: project discovered and webhook registered1707gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1708gitlab # [ 335.069777] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2181709gitlab # [ 335.073254] nixbot[3529]: {"ts": "2026-08-20T08:21:46.960Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1710gitlab # [ 335.140120] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1821711gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.21 seconds)1712(finished: subtest: project discovered and webhook registered, in 0.21 seconds)1713subtest: push delivers the webhook1714gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1715gitlab # [ 335.273294] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 541716gitlab # [ 335.289415] nixbot[3529]: {"ts": "2026-08-20T08:21:47.177Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1717gitlab # [ 335.292055] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2011718gitlab # [ 335.372658] gitaly[910]: time="2026-08-20T08:21:47.260Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464GVVWQ8NX9CPX6KDZYH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:47.238" grpc.time_ms=21.229 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 335.387980] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 971720gitlab # Enumerating objects: 5, done.1721gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)[ 335.392865] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 831722gitlab # Counting objects: 80% (4/5)[ 335.395259] nixbot[3529]: {"ts": "2026-08-20T08:21:47.283Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1723gitlab # Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1724gitlab # Delta compression using up to 4 threads1725gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1726gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1727gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1728gitlab # [ 335.475800] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 721729gitlab # [ 335.478230] nixbot[3529]: {"ts": "2026-08-20T08:21:47.366Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1730gitlab # [ 335.578898] gitaly[910]: time="2026-08-20T08:21:47.467Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F464QP3SWA9RADFQAGJYM1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T08:22:17.045" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:47.445" grpc.time_ms=20.491 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1731gitlab # [ 335.608884] gitaly[910]: time="2026-08-20T08:21:47.497Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F464QP3SWA9RADFQAGJYM1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:22:17.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:21:47.495" grpc.time_ms=1.524 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 335.642196] gitaly[910]: time="2026-08-20T08:21:47.530Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F464QP3SWA9RADFQAGJYM1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T08:21:57.076" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:21:47.516" grpc.time_ms=13.539 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1733gitlab # [ 335.701159] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2061734gitlab # [ 335.705367] nixbot[3529]: {"ts": "2026-08-20T08:21:47.590Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1735gitlab # [ 335.711537] gitaly[910]: time="2026-08-20T08:21:47.599Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T08:22:17.076" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T08:21:47.577" grpc.time_ms=22.635 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1736gitlab # [ 335.770235] gitaly[910]: time="2026-08-20T08:21:47.658Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B duration_ms=205ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/allowed"1737gitlab # [ 335.802169] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 931738gitlab # [ 335.805232] nixbot[3529]: {"ts": "2026-08-20T08:21:47.690Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1739gitlab # [ 335.808163] nixbot[3529]: {"ts": "2026-08-20T08:21:47.694Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1740gitlab # [ 335.822922] gitaly[910]: time="2026-08-20T08:21:47.710Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B duration_ms=50ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/pre_receive"1741gitlab # [ 335.836630] gitaly[910]: time="2026-08-20T08:21:47.711Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:47.452" grpc.time_ms=258.789 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1742gitlab # [ 335.888886] gitaly[910]: time="2026-08-20T08:21:47.777Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:47.776" grpc.time_ms=0.95 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab # [ 335.937866] gitaly[910]: time="2026-08-20T08:21:47.826Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:47.825" grpc.time_ms=0.378 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1744gitlab # [ 335.952103] gitaly[910]: time="2026-08-20T08:21:47.831Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F46535D1SYTXY53XQSK1KJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:47.815" grpc.time_ms=15.742 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 335.968312] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 871746gitlab # [ 335.979769] gitaly[910]: time="2026-08-20T08:21:47.868Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:47.867" grpc.time_ms=0.477 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1747gitlab # [ 336.071612] gitaly[910]: time="2026-08-20T08:21:47.959Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B duration_ms=51ns method=POST pid=910 status=200 url="http://unix/api/v4/internal/post_receive"1748gitlab # [ 336.081105] gitaly[910]: time="2026-08-20T08:21:47.960Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:47.908" grpc.time_ms=52.265 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1749gitlab # [ 336.111517] gitaly[910]: time="2026-08-20T08:21:47.999Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B diskcache=9d0aa023-706e-4217-938c-0dcd32eaa13a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:47.376" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1750gitlab # [ 336.134885] gitaly[910]: time="2026-08-20T08:21:48.000Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=231 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=12951 command.oublock=32 command.real_time_ms=599 command.spawn_token_fork_ms=0 command.system_time_ms=139 command.user_time_ms=92 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:47.376" grpc.time_ms=623.357 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1751gitlab # To http://gitlab/root/test-flake.git1752gitlab # [ 336.157894] gitlab-workhorse[825]: time="2026-08-20T08:21:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521753gitlab # [ 336.161519] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:48 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7031754gitlab # 661aba8..76fc2c7 master -> master1755gitlab # [ 336.177655] gitaly[910]: time="2026-08-20T08:21:48.066Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F46561AJADXQFPYN2RPTWE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.049" pid=910 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1756gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.06 seconds)1757gitlab: must succeed: git -C /tmp/test-flake rev-parse master1758gitlab # [ 336.197395] gitaly[910]: time="2026-08-20T08:21:48.072Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46561AJADXQFPYN2RPTWE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.049" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1759gitlab # [ 336.221706] gitlab-workhorse[825]: time="2026-08-20T08:21:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131760gitlab # [ 336.224847] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2311761gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.04 seconds)1762gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1763gitlab # [ 336.227814] gitaly[910]: time="2026-08-20T08:21:48.073Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46561AJADXQFPYN2RPTWE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.049" grpc.time_ms=23.611 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1764gitlab # [ 336.295120] gitaly[910]: time="2026-08-20T08:21:48.183Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F465DQAD3FJQMF3Q7NHPHY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.163" pid=910 remote_ip="2001:db8:1::1" request_sha=c6e8ded805b50fd12ea546ab9488c1bec82a6571 response_bytes=417 span.kind=server system=grpc1765gitlab # [ 336.310328] gitaly[910]: time="2026-08-20T08:21:48.183Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1132 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0F465DQAD3FJQMF3Q7NHPHY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.163" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1766gitlab # [ 336.331151] gitlab-workhorse[825]: time="2026-08-20T08:21:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4171767gitlab # [ 336.333729] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 417 "" "git/2.55.0" 961768gitlab # [ 336.336188] gitaly[910]: time="2026-08-20T08:21:48.184Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1132 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0F465DQAD3FJQMF3Q7NHPHY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.163" grpc.time_ms=20.17 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1769gitlab # [ 336.368033] nixbot[3529]: INFO: ::ffff:127.0.0.1:49400 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1770gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.13 seconds)1771gitlab # [ 336.499370] gitaly[910]: time="2026-08-20T08:21:48.386Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=12 component=gitaly.StreamServerInterceptor correlation_id=01M0F465KJWP9RWS01DK05ETRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.369" grpc.time_ms=16.846 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1772gitlab # [ 336.540109] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1121773gitlab # [ 336.602449] gitaly[910]: time="2026-08-20T08:21:48.490Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F465Q56VXQN06Y681MVM0F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.472" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1774gitlab # [ 336.631159] gitaly[910]: time="2026-08-20T08:21:48.490Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F465Q56VXQN06Y681MVM0F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.472" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1775gitlab # [ 336.656398] gitlab-workhorse[825]: time="2026-08-20T08:21:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671776gitlab # [ 336.659290] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1011777gitlab # [ 336.662339] gitaly[910]: time="2026-08-20T08:21:48.491Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F465Q56VXQN06Y681MVM0F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.472" grpc.time_ms=18.842 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1778gitlab # [ 336.788215] gitaly[910]: time="2026-08-20T08:21:48.676Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F465WMXJKC2WYF9Z6KFGY5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.657" grpc.time_ms=18.622 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1779gitlab # [ 336.826096] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1131780gitlab # [ 336.943733] gitaly[910]: time="2026-08-20T08:21:48.832Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F46609A0SX8TZRA8X9MYMX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.795" pid=910 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1781gitlab # [ 336.976477] gitaly[910]: time="2026-08-20T08:21:48.832Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1105 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=2 command.system_time_ms=23 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46609A0SX8TZRA8X9MYMX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.795" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1782gitlab # [ 337.008843] gitlab-workhorse[825]: time="2026-08-20T08:21:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091783gitlab # [ 337.012108] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1521784gitlab # [ 337.015500] gitaly[910]: time="2026-08-20T08:21:48.833Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1105 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=2 command.system_time_ms=23 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46609A0SX8TZRA8X9MYMX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:48.795" grpc.time_ms=37.06 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1785gitlab # [ 337.132303] gitaly[910]: time="2026-08-20T08:21:49.020Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:22:19.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:21:49.019" grpc.time_ms=1.138 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 337.239468] gitaly[910]: time="2026-08-20T08:21:49.127Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:22:19.106" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:49.106" grpc.time_ms=20.317 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 337.295695] gitaly[910]: time="2026-08-20T08:21:49.183Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:21:59.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:49.164" grpc.time_ms=19.382 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 337.331697] gitaly[910]: time="2026-08-20T08:21:49.220Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:21:59.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:49.203" grpc.time_ms=15.99 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1790gitlab # [ 337.435510] nixbot[3529]: INFO: ::ffff:127.0.0.1:49402 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1791gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.07 seconds)1792gitlab # [ 337.515397] gitaly[910]: time="2026-08-20T08:21:49.402Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:21:59.241" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:49.401" grpc.time_ms=0.674 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 337.585012] gitaly[910]: time="2026-08-20T08:21:49.473Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:21:59.294" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:49.455" grpc.time_ms=17.309 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 337.660228] gitaly[910]: time="2026-08-20T08:21:49.548Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:49.547" grpc.time_ms=0.889 pid=910 span.kind=server system=grpc1795gitlab # [ 337.715060] gitaly[910]: time="2026-08-20T08:21:49.603Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:21:49.602" grpc.time_ms=0.785 pid=910 span.kind=server system=grpc1796gitlab # [ 337.746398] gitaly[910]: time="2026-08-20T08:21:49.617Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 diskcache=08ab1057-def7-49b6-9c7f-5ecd03358361 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:21:59.008" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:49.478" pid=910 ref=refs/keep-around/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf remote_ip="2001:db8:1::1" revision=661aba856ec9c6ff8b7f3dbf60662501aa8a07cf span.kind=server system=grpc username=root1797gitlab # [ 337.777275] gitaly[910]: time="2026-08-20T08:21:49.617Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=135 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5246 command.oublock=8 command.real_time_ms=130 command.spawn_token_fork_ms=2 command.system_time_ms=85 command.user_time_ms=50 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:21:59.008" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:21:49.478" grpc.time_ms=138.321 pid=910 ref=refs/keep-around/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf remote_ip="2001:db8:1::1" revision=661aba856ec9c6ff8b7f3dbf60662501aa8a07cf span.kind=server system=grpc username=root1798gitlab # [ 337.807133] gitaly[910]: time="2026-08-20T08:21:49.624Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:22:19.122" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:21:49.623" grpc.time_ms=0.74 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 338.081156] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 10581800gitlab # [ 338.089467] nixbot[3529]: {"ts": "2026-08-20T08:21:49.970Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf \"HTTP/1.1 201 Created\""}1801gitlab # [ 338.098261] nixbot[3529]: {"ts": "2026-08-20T08:21:49.982Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-661aba856ec9-0"}1802gitlab # [ 338.202746] systemd[1]: Started Nix Daemon.1803gitlab # [ 338.319204] nix-daemon[3744]: accepted connection from pid 3738, user nixbot1804gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1805gitlab # [ 338.446678] nix-daemon[3744]: accepted connection from pid 3751, user nixbot1806gitlab # [ 338.482041] nixbot[3529]: {"ts": "2026-08-20T08:21:50.369Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-661aba856ec9-0", "argv0": "bwrap"}1807gitlab # [ 338.541067] nixbot[3529]: INFO: ::ffff:127.0.0.1:49414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1808gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.11 seconds)1809gitlab # [ 338.715607] nix-daemon[3744]: accepted connection from pid 3764, user nixbot1810gitlab # [ 338.798307] nix-daemon[3744]: accepted connection from pid 3774, user nixbot1811gitlab # [ 338.819182] nix-daemon[3744]: accepted connection from pid 3764, user nixbot1812gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1813gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1814gitlab # [ 339.606326] nixbot[3529]: INFO: ::ffff:127.0.0.1:49416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1815gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1816gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1817gitlab # [ 340.660301] nixbot[3529]: INFO: ::ffff:127.0.0.1:49432 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1818gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1819gitlab # [ 341.715973] nixbot[3529]: INFO: ::ffff:127.0.0.1:38456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1820gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1821gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1822gitlab # [ 342.771560] nixbot[3529]: INFO: ::ffff:127.0.0.1:38470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1823gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1824gitlab # [ 343.419673] gitaly[910]: time="2026-08-20T08:21:55.306Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46CBJHNMTY53PX4AV50KS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:22:25.304" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:21:55.305" grpc.time_ms=1.194 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 343.648115] gitaly[910]: time="2026-08-20T08:21:55.536Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F46CBJHNMTY53PX4AV50KS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:22:05.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:55.517" grpc.time_ms=18.167 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 343.756240] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 4561827gitlab # [ 343.761960] nixbot[3529]: {"ts": "2026-08-20T08:21:55.646Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf \"HTTP/1.1 201 Created\""}1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1829gitlab # [ 343.817052] nixbot[3529]: INFO: ::ffff:127.0.0.1:38486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1830gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.04 seconds)1831gitlab # [ 343.881305] gitaly[910]: time="2026-08-20T08:21:55.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46CT7VP0EPJGCF36EK9EY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:22:25.267" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:21:55.768" grpc.time_ms=1.319 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab # [ 343.939423] gitaly[910]: time="2026-08-20T08:21:55.827Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F46CT7VP0EPJGCF36EK9EY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:22:05.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:55.813" grpc.time_ms=13.635 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab # [ 344.081099] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3131834gitlab # [ 344.087021] nixbot[3529]: {"ts": "2026-08-20T08:21:55.971Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf \"HTTP/1.1 201 Created\""}1835gitlab # [ 344.213915] gitaly[910]: time="2026-08-20T08:21:56.101Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46D4TTQRE88FSPBG7ABKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:22:26.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:21:56.100" grpc.time_ms=1.088 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 344.268967] gitaly[910]: time="2026-08-20T08:21:56.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0F46D4TTQRE88FSPBG7ABKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:22:06.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:21:56.141" grpc.time_ms=15.212 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 344.375248] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2681838gitlab # [ 344.383643] nixbot[3529]: {"ts": "2026-08-20T08:21:56.265Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf \"HTTP/1.1 201 Created\""}1839gitlab # [ 344.536553] nix-daemon[3744]: accepted connection from pid 3812, user nixbot1840gitlab # [ 344.738998] gitaly[910]: time="2026-08-20T08:21:56.626Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F46DN3TDDZ74X19PZA0ZYH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:56.607" grpc.time_ms=18.56 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1841gitlab # [ 344.768800] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1131842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1844gitlab # [ 344.880222] nixbot[3529]: INFO: ::ffff:127.0.0.1:38488 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1845gitlab # [ 344.923715] gitaly[910]: time="2026-08-20T08:21:56.811Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F46DSJSTAMKNPGJ6RQN0FF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:56.791" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1846gitlab # [ 344.953636] gitaly[910]: time="2026-08-20T08:21:56.812Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46DSJSTAMKNPGJ6RQN0FF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:56.791" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1847gitlab # [ 344.977890] gitlab-workhorse[825]: time="2026-08-20T08:21:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671848gitlab # [ 344.980918] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:21:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1551849gitlab # [ 344.983598] gitaly[910]: time="2026-08-20T08:21:56.813Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F46DSJSTAMKNPGJ6RQN0FF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:21:56.791" grpc.time_ms=20.729 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc1850gitlab # [ 345.101446] nix-daemon[3744]: accepted connection from pid 3841, user nixbot1851gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1852gitlab # [ 345.936638] nixbot[3529]: INFO: ::ffff:127.0.0.1:38502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1853gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1854gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1856gitlab # [ 346.994459] nixbot[3529]: INFO: ::ffff:127.0.0.1:38506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1857gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1858gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1859gitlab # [ 348.050077] nixbot[3529]: INFO: ::ffff:127.0.0.1:38510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1862gitlab # [ 349.106949] nixbot[3529]: INFO: ::ffff:127.0.0.1:38524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1863gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1864gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1865gitlab # [ 350.162520] nixbot[3529]: INFO: ::ffff:127.0.0.1:38540 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1866gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1867gitlab # [ 351.217941] nixbot[3529]: INFO: ::ffff:127.0.0.1:53362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1868gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1870gitlab # [ 352.273916] nixbot[3529]: INFO: ::ffff:127.0.0.1:53364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1871gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1874gitlab # [ 353.330298] nixbot[3529]: INFO: ::ffff:127.0.0.1:53376 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1876gitlab # [ 354.384868] nixbot[3529]: INFO: ::ffff:127.0.0.1:53380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1877gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1878gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1879gitlab # [ 355.441625] nixbot[3529]: INFO: ::ffff:127.0.0.1:53396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1880gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1882gitlab # [ 356.497648] nixbot[3529]: INFO: ::ffff:127.0.0.1:53398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1883gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1885gitlab # [ 357.554834] nixbot[3529]: INFO: ::ffff:127.0.0.1:53410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1886gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1888gitlab # [ 358.611247] nixbot[3529]: INFO: ::ffff:127.0.0.1:53424 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1892gitlab # [ 359.669177] nixbot[3529]: INFO: ::ffff:127.0.0.1:53440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1894gitlab # [ 360.722853] nixbot[3529]: INFO: ::ffff:127.0.0.1:53442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1896gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1897gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1898gitlab # [ 361.778973] nixbot[3529]: INFO: ::ffff:127.0.0.1:45462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1899gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1900gitlab # [ 362.832197] nixbot[3529]: INFO: ::ffff:127.0.0.1:45472 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1901gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1903gitlab # [ 363.888337] nixbot[3529]: INFO: ::ffff:127.0.0.1:45484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1904gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1905gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1906gitlab # [ 364.944912] nixbot[3529]: INFO: ::ffff:127.0.0.1:45496 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1907gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1909gitlab # [ 366.003238] nixbot[3529]: INFO: ::ffff:127.0.0.1:45510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1910gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1912gitlab # [ 367.059959] nixbot[3529]: INFO: ::ffff:127.0.0.1:45526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1914gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1915gitlab # [ 368.116302] nixbot[3529]: INFO: ::ffff:127.0.0.1:45528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1918gitlab # [ 369.172888] nixbot[3529]: INFO: ::ffff:127.0.0.1:45538 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1920gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1921gitlab # [ 370.229393] nixbot[3529]: INFO: ::ffff:127.0.0.1:45544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1922gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1923gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1924gitlab # [ 371.284798] nixbot[3529]: INFO: ::ffff:127.0.0.1:57498 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1925gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1926gitlab # [ 371.851482] sidekiq-cluster[3479]: 2026-08-20T08:22:23.738Z pid=3479 tid=ym7 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3479, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>430440448}1927gitlab # [ 372.133435] sidekiq-cluster[3479]: W, [2026-08-20T08:22:24.021595 #3479] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1928gitlab # [ 372.198184] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:22:24.086Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1930gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1931gitlab # [ 372.341024] nixbot[3529]: INFO: ::ffff:127.0.0.1:57514 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1933gitlab # [ 373.394461] nixbot[3529]: INFO: ::ffff:127.0.0.1:57518 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1936gitlab # [ 374.450829] nixbot[3529]: INFO: ::ffff:127.0.0.1:57534 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1937gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1939gitlab # [ 375.508178] nixbot[3529]: INFO: ::ffff:127.0.0.1:57548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1940gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1941gitlab # [ 375.741297] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:22:27.628Z","message":"GitLab reliable fetch activated!"}1942gitlab # [ 375.746346] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:22:27.628Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1943gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1944gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1945gitlab # [ 376.566343] nixbot[3529]: INFO: ::ffff:127.0.0.1:57564 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1946gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1947gitlab # [ 377.620725] nixbot[3529]: INFO: ::ffff:127.0.0.1:57566 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1948gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1949gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1950gitlab # [ 378.677600] nixbot[3529]: INFO: ::ffff:127.0.0.1:57582 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1951gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1952gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1954gitlab # [ 379.736308] nixbot[3529]: INFO: ::ffff:127.0.0.1:57592 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1955gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1957gitlab # [ 380.793000] nixbot[3529]: INFO: ::ffff:127.0.0.1:57602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1958gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1960gitlab # [ 381.846954] nixbot[3529]: INFO: ::ffff:127.0.0.1:33342 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1961gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1962gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1963gitlab # [ 382.902723] nixbot[3529]: INFO: ::ffff:127.0.0.1:33344 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1964gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1965gitlab # [ 383.956776] nixbot[3529]: INFO: ::ffff:127.0.0.1:33358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1966gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1969gitlab # [ 385.013486] nixbot[3529]: INFO: ::ffff:127.0.0.1:33374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1971gitlab # [ 386.066898] nixbot[3529]: INFO: ::ffff:127.0.0.1:33384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1974gitlab # [ 387.122300] nixbot[3529]: INFO: ::ffff:127.0.0.1:33392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1978gitlab # [ 388.178033] nixbot[3529]: INFO: ::ffff:127.0.0.1:33402 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1980gitlab # [ 389.231610] nixbot[3529]: INFO: ::ffff:127.0.0.1:33404 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1981gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1984gitlab # [ 390.288365] nixbot[3529]: INFO: ::ffff:127.0.0.1:33416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1986gitlab # [ 391.342309] nixbot[3529]: INFO: ::ffff:127.0.0.1:58016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1989gitlab # [ 392.398245] nixbot[3529]: INFO: ::ffff:127.0.0.1:58024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1990gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)1993gitlab # [ 393.454031] nixbot[3529]: INFO: ::ffff:127.0.0.1:58030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1995gitlab # [ 394.506878] nixbot[3529]: INFO: ::ffff:127.0.0.1:58038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'1998gitlab # [ 395.563262] nixbot[3529]: INFO: ::ffff:127.0.0.1:58046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2002gitlab # [ 396.619960] nixbot[3529]: INFO: ::ffff:127.0.0.1:58052 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2004gitlab # [ 397.672553] nixbot[3529]: INFO: ::ffff:127.0.0.1:58056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2008gitlab # [ 398.728889] nixbot[3529]: INFO: ::ffff:127.0.0.1:58068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2010gitlab # [ 399.782050] nixbot[3529]: INFO: ::ffff:127.0.0.1:58070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2013gitlab # [ 400.837630] nixbot[3529]: INFO: ::ffff:127.0.0.1:53682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2016gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2017gitlab # [ 401.893254] nixbot[3529]: INFO: ::ffff:127.0.0.1:53686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2020gitlab # [ 402.945658] nixbot[3529]: INFO: ::ffff:127.0.0.1:53692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2023gitlab # [ 403.999118] nixbot[3529]: INFO: ::ffff:127.0.0.1:53696 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2025gitlab # [ 405.053790] nixbot[3529]: INFO: ::ffff:127.0.0.1:53704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2027gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2028gitlab # [ 406.109911] nixbot[3529]: INFO: ::ffff:127.0.0.1:53714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2031gitlab # [ 407.166185] nixbot[3529]: INFO: ::ffff:127.0.0.1:53718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2034gitlab # [ 408.223596] nixbot[3529]: INFO: ::ffff:127.0.0.1:53734 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2038gitlab # [ 409.278687] nixbot[3529]: INFO: ::ffff:127.0.0.1:53736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2040gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2041gitlab # [ 410.332567] nixbot[3529]: INFO: ::ffff:127.0.0.1:53744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2044gitlab # [ 411.386832] nixbot[3529]: INFO: ::ffff:127.0.0.1:53680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2045gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2046gitlab # [ 412.441059] nixbot[3529]: INFO: ::ffff:127.0.0.1:53696 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2049gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2050gitlab # [ 413.497155] nixbot[3529]: INFO: ::ffff:127.0.0.1:53710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2051gitlab # [ 413.923987] postgres[4060]: [4060] ERROR: relation "table_without_models" does not exist2052gitlab # [ 413.928760] postgres[4060]: [4060] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2053gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2054gitlab # [ 414.552405] nixbot[3529]: INFO: ::ffff:127.0.0.1:53724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2056gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2057gitlab # [ 415.608959] nixbot[3529]: INFO: ::ffff:127.0.0.1:53730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2059gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2060gitlab # [ 416.665541] nixbot[3529]: INFO: ::ffff:127.0.0.1:53746 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2061gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2062gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2063gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2064gitlab # [ 417.721948] nixbot[3529]: INFO: ::ffff:127.0.0.1:53754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2065gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2066gitlab # [ 418.774881] nixbot[3529]: INFO: ::ffff:127.0.0.1:53756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2067gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2068gitlab # [ 418.807429] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:10.695Z","message":"Booted Rails 7.2.3.1 application in production environment"}2069gitlab # [ 418.809856] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:10.696Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2070gitlab # [ 418.811816] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:10.696Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2071gitlab # [ 418.813725] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:10.696Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2072gitlab # [ 418.815725] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:10.699Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2073gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2074gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2075gitlab # [ 419.832879] nixbot[3529]: INFO: ::ffff:127.0.0.1:53770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2076gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2077gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.05 seconds)2078gitlab # [ 420.886239] nixbot[3529]: INFO: ::ffff:127.0.0.1:39070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2079gitlab # [ 421.534480] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:13.420Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4c6740a76fbc68db73e8758d","created_at":"2026-08-20T08:21:39.840Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:39.896Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4c6740a76fbc68db73e8758d: start","job_status":"start","queue_duration_s":93.524525,"scheduling_latency_s":93.524647}2080gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2081gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2082gitlab # [ 421.935638] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:13.822Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4c6740a76fbc68db73e8758d","created_at":"2026-08-20T08:21:39.840Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:39.896Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4c6740a76fbc68db73e8758d: done: 0.402292 sec","job_status":"done","queue_duration_s":93.524525,"scheduling_latency_s":93.524647,"redis_calls":23,"redis_duration_s":0.016296,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.010821,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003326,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20154862,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.402292,"completed_at":"2026-08-20T08:23:13.822Z","load_balancing_strategy":"primary","db_duration_s":0.109809,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2083gitlab # [ 422.029907] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:13.828Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c15707997b75134f1a9134cd","created_at":"2026-08-20T08:21:39.916Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:39.925Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c15707997b75134f1a9134cd: start","job_status":"start","queue_duration_s":93.902695,"scheduling_latency_s":93.902753}2084gitlab # [ 422.048386] nixbot[3529]: INFO: ::ffff:127.0.0.1:39074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2085gitlab # [ 422.164512] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.051Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"c15707997b75134f1a9134cd","created_at":"2026-08-20T08:21:39.916Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:39.925Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-c15707997b75134f1a9134cd: done: 0.22412 sec","job_status":"done","queue_duration_s":93.902695,"scheduling_latency_s":93.902753,"redis_calls":14,"redis_duration_s":0.006145,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001275,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002837,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.169254,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16648581999999998,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.22412,"completed_at":"2026-08-20T08:23:14.051Z","load_balancing_strategy":"primary","db_duration_s":0.040212,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2086gitlab # [ 422.263444] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.055Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"e2759e0309958dd011d9af36","created_at":"2026-08-20T08:21:40.671Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:40.685Z","job_size_bytes":5,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-e2759e0309958dd011d9af36: start","job_status":"start","queue_duration_s":93.369682,"scheduling_latency_s":93.369719}2087gitlab # [ 422.415007] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.302Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"e2759e0309958dd011d9af36","created_at":"2026-08-20T08:21:40.671Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:40.685Z","job_size_bytes":5,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-e2759e0309958dd011d9af36: done: 0.247809 sec","job_status":"done","queue_duration_s":93.369682,"scheduling_latency_s":93.369719,"redis_calls":12,"redis_duration_s":0.003898,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000925,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002309,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050908,"duration_s":0.247809,"completed_at":"2026-08-20T08:23:14.302Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045847,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2088gitlab # [ 422.522254] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.304Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d83d6d04c303c9ceb1ba2c54","created_at":"2026-08-20T08:21:40.753Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:40.766Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d83d6d04c303c9ceb1ba2c54: start","job_status":"start","queue_duration_s":93.538202,"scheduling_latency_s":93.538225}2089gitlab # [ 422.697698] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.584Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d83d6d04c303c9ceb1ba2c54","created_at":"2026-08-20T08:21:40.753Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:40.766Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d83d6d04c303c9ceb1ba2c54: done: 0.279359 sec","job_status":"done","queue_duration_s":93.538202,"scheduling_latency_s":93.538225,"redis_calls":11,"redis_duration_s":0.003317,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000645,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.235,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.235,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.171036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057742,"duration_s":0.279359,"completed_at":"2026-08-20T08:23:14.584Z","load_balancing_strategy":"primary","db_duration_s":0.110962,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2090gitlab # [ 422.793608] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.586Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"dfc7893ed2f8acb5034072fe","created_at":"2026-08-20T08:21:40.775Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:40.787Z","job_size_bytes":89,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-dfc7893ed2f8acb5034072fe: start","job_status":"start","queue_duration_s":93.79847,"scheduling_latency_s":93.798495}2091gitlab # [ 422.814292] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.636Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"dfc7893ed2f8acb5034072fe","created_at":"2026-08-20T08:21:40.775Z","trace_propagation_headers":{"sentry-trace":"804eee4d4dde4462b5049a364e09a897-9b0b7f07d6b24f7f","baggage":"sentry-trace_id=804eee4d4dde4462b5049a364e09a897,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F45VWSP98NESHNPJCZG9EG","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:40.787Z","job_size_bytes":89,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-dfc7893ed2f8acb5034072fe: done: 0.050614 sec","job_status":"done","queue_duration_s":93.79847,"scheduling_latency_s":93.798495,"redis_calls":11,"redis_duration_s":0.003334,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000896,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051812,"duration_s":0.050614,"completed_at":"2026-08-20T08:23:14.636Z","load_balancing_strategy":"primary","db_duration_s":0.009195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2092gitlab # [ 422.863926] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.638Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 661aba856ec9c6ff8b7f3dbf60662501aa8a07cf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d8c8f63ff70cc9f54ac49f30","created_at":"2026-08-20T08:21:43.933Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-36ea50c8f82d4adc","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:43.945Z","job_size_bytes":185,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d8c8f63ff70cc9f54ac49f30: start","job_status":"start","queue_duration_s":90.693755,"scheduling_latency_s":90.693776}2093gitlab # [ 422.885175] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:14.658Z","message":"changes: \"0000000000000000000000000000000000000000 661aba856ec9c6ff8b7f3dbf60662501aa8a07cf refs/heads/master\\n\""}2094gitlab # [ 422.888327] gitaly[910]: time="2026-08-20T08:23:14.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:24.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:14.692" grpc.time_ms=14.565 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 422.902575] gitaly[910]: time="2026-08-20T08:23:14.731Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:23:24.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:14.713" grpc.time_ms=17.422 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2097gitlab # [ 422.933221] gitaly[910]: time="2026-08-20T08:23:14.821Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:23:24.110" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:14.801" grpc.time_ms=20.379 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 422.997170] nixbot[3529]: INFO: ::ffff:127.0.0.1:39084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2099gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2100gitlab # [ 423.016322] gitaly[910]: time="2026-08-20T08:23:14.904Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:14.903" grpc.time_ms=0.742 pid=910 span.kind=server system=grpc2101gitlab # [ 423.070070] gitaly[910]: time="2026-08-20T08:23:14.958Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:14.957" grpc.time_ms=0.682 pid=910 span.kind=server system=grpc2102gitlab # [ 423.099674] gitaly[910]: time="2026-08-20T08:23:14.970Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X diskcache=64b243cc-08de-42bc-b9e1-0af2d3f85b32 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:23:24.148" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:14.839" pid=910 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2103gitlab # [ 423.124051] gitaly[910]: time="2026-08-20T08:23:14.970Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=140 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5250 command.oublock=8 command.real_time_ms=125 command.spawn_token_fork_ms=1 command.system_time_ms=85 command.user_time_ms=55 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:23:24.148" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:14.839" grpc.time_ms=131.636 pid=910 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2104gitlab # [ 423.152001] gitaly[910]: time="2026-08-20T08:23:15.001Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T08:23:24.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:15.000" grpc.time_ms=0.358 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 423.169074] gitaly[910]: time="2026-08-20T08:23:15.036Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=859 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T08:23:25.010" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:15.010" grpc.time_ms=25.791 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 423.328519] gitaly[910]: time="2026-08-20T08:23:15.216Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T08:23:45.003" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:15.204" grpc.time_ms=12.164 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 423.386418] gitaly[910]: time="2026-08-20T08:23:15.274Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:23:25.273" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:15.274" grpc.time_ms=0.543 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 423.417038] gitaly[910]: time="2026-08-20T08:23:15.290Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:23:25.278" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:23:15.278" grpc.time_ms=11.583 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 423.446150] gitaly[910]: time="2026-08-20T08:23:15.334Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:25.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:15.316" grpc.time_ms=17.816 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 423.475184] gitaly[910]: time="2026-08-20T08:23:15.363Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:25.035" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:15.345" grpc.time_ms=17.458 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 423.527937] gitaly[910]: time="2026-08-20T08:23:15.416Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=878 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:23:45.186" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:15.387" grpc.time_ms=29.021 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2113gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2114gitlab # [ 424.057433] nixbot[3529]: INFO: ::ffff:127.0.0.1:39096 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2115gitlab # [ 424.256857] gitaly[910]: time="2026-08-20T08:23:16.144Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:23:26.140" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:16.140" grpc.time_ms=3.121 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 424.332834] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.218Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 661aba856ec9c6ff8b7f3dbf60662501aa8a07cf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d8c8f63ff70cc9f54ac49f30","created_at":"2026-08-20T08:21:43.933Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-36ea50c8f82d4adc","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:43.945Z","job_size_bytes":185,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d8c8f63ff70cc9f54ac49f30: done: 1.579838 sec","job_status":"done","queue_duration_s":90.693755,"scheduling_latency_s":90.693776,"gitaly_calls":13,"gitaly_duration_s":0.358301,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.06713,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.006491,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009691,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002675,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005783,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.026859,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015631,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.094,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.314,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.363,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.094,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.06422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00081116,"exclusive_lock_hold_duration_s":0.03748906,"duration_s":1.579838,"completed_at":"2026-08-20T08:23:16.218Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.165534,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2117gitlab # [ 424.441956] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.222Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","661aba856ec9c6ff8b7f3dbf60662501aa8a07cf 76fc2c714d939d1c6b4fb858e107c3c988ec740c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d586050b7a3f95bae9866b13","created_at":"2026-08-20T08:21:47.940Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-13a7e21cc0e74afa","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:47.943Z","job_size_bytes":185,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d586050b7a3f95bae9866b13: start","job_status":"start","queue_duration_s":88.278812,"scheduling_latency_s":88.278853}2118gitlab # [ 424.463564] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.244Z","message":"changes: \"661aba856ec9c6ff8b7f3dbf60662501aa8a07cf 76fc2c714d939d1c6b4fb858e107c3c988ec740c refs/heads/master\\n\""}2119gitlab # [ 424.466467] gitaly[910]: time="2026-08-20T08:23:16.303Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:26.284" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:16.285" grpc.time_ms=18.286 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 424.480926] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.339Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b9b690e9a415a691ad03fab4","created_at":"2026-08-20T08:23:16.335Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-d5fc12a6e808474c","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"dad98e1013b7ab69ece8d469","job_size_bytes":46,"pid":3479,"job_status":"deduplicated","message":"ProjectCacheWorker JID-b9b690e9a415a691ad03fab4: deduplicated: until executing","deduplication.type":"until executing"}2121gitlab # [ 424.495750] gitaly[910]: time="2026-08-20T08:23:16.330Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T08:23:26.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:16.313" grpc.time_ms=16.254 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 424.509012] gitaly[910]: time="2026-08-20T08:23:16.385Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T08:23:26.057" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:16.367" grpc.time_ms=17.743 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 424.525383] gitaly[910]: time="2026-08-20T08:23:16.413Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T08:23:46.193" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:16.394" grpc.time_ms=19.469 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 424.557580] gitaly[910]: time="2026-08-20T08:23:16.445Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T08:23:26.124" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T08:23:16.434" grpc.time_ms=11.047 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 424.592545] gitaly[910]: time="2026-08-20T08:23:16.480Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:26.154" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:16.464" grpc.time_ms=16.346 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 424.903764] gitaly[910]: time="2026-08-20T08:23:16.792Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T08:23:26.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:16.654" grpc.time_ms=137.408 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab # [ 424.949203] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.836Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","661aba856ec9c6ff8b7f3dbf60662501aa8a07cf 76fc2c714d939d1c6b4fb858e107c3c988ec740c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d586050b7a3f95bae9866b13","created_at":"2026-08-20T08:21:47.940Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-13a7e21cc0e74afa","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T08:21:47.943Z","job_size_bytes":185,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d586050b7a3f95bae9866b13: done: 0.614501 sec","job_status":"done","queue_duration_s":88.278812,"scheduling_latency_s":88.278853,"gitaly_calls":7,"gitaly_duration_s":0.267472,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.038986,"redis_read_bytes":500,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.004003,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001731,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005471,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.013878,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013903,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.045,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.045,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.43698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00161238,"exclusive_lock_hold_duration_s":0.03919968,"duration_s":0.614501,"completed_at":"2026-08-20T08:23:16.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043897,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2128gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2129gitlab # [ 425.053163] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.839Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ef39c7422dbf539f75a609ab","created_at":"2026-08-20T08:21:49.651Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-9a82c9c08a9842a8","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:49.665Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ef39c7422dbf539f75a609ab: start","job_status":"start","queue_duration_s":87.173983,"scheduling_latency_s":87.174021}2130gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.07 seconds)2131gitlab # [ 425.099293] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.987Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ef39c7422dbf539f75a609ab","created_at":"2026-08-20T08:21:49.651Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-9a82c9c08a9842a8","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:49.665Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ef39c7422dbf539f75a609ab: done: 0.147779 sec","job_status":"done","queue_duration_s":87.173983,"scheduling_latency_s":87.174021,"redis_calls":16,"redis_duration_s":0.006079,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003415,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051232,"duration_s":0.147779,"completed_at":"2026-08-20T08:23:16.986Z","load_balancing_strategy":"primary","db_duration_s":0.041461,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2132gitlab # [ 425.176036] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:16.989Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4a6b11699fe8d4b9312d3f24","created_at":"2026-08-20T08:21:49.666Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-9a82c9c08a9842a8","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:49.678Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4a6b11699fe8d4b9312d3f24: start","job_status":"start","queue_duration_s":87.311381,"scheduling_latency_s":87.311416}2133gitlab # [ 425.196179] nixbot[3529]: INFO: ::ffff:127.0.0.1:39110 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2134gitlab # [ 425.270206] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:17.157Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4a6b11699fe8d4b9312d3f24","created_at":"2026-08-20T08:21:49.666Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-9a82c9c08a9842a8","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:49.678Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4a6b11699fe8d4b9312d3f24: done: 0.168434 sec","job_status":"done","queue_duration_s":87.311381,"scheduling_latency_s":87.311416,"redis_calls":21,"redis_duration_s":0.01063,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003265,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00195,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006329,"duration_s":0.168434,"completed_at":"2026-08-20T08:23:17.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 425.356426] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:17.160Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"da05ca528d0fa9e098653709","created_at":"2026-08-20T08:21:49.924Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-9a82c9c08a9842a8","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:49.935Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-da05ca528d0fa9e098653709: start","job_status":"start","queue_duration_s":87.224752,"scheduling_latency_s":87.224779}2136gitlab # [ 425.542845] gitaly[910]: time="2026-08-20T08:23:17.429Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:17.429" grpc.time_ms=0.699 pid=910 span.kind=server system=grpc2137gitlab # [ 425.585759] gitaly[910]: time="2026-08-20T08:23:17.474Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:17.473" grpc.time_ms=0.697 pid=910 span.kind=server system=grpc2138gitlab # [ 425.641672] gitaly[910]: time="2026-08-20T08:23:17.530Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:17.529" grpc.time_ms=0.694 pid=910 span.kind=server system=grpc2139gitlab # [ 425.671386] gitaly[910]: time="2026-08-20T08:23:17.542Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 diskcache=8b53e28e-bfb7-41ca-a29b-1f3c9d619ba9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:23:47.168" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:17.369" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 425.693179] gitaly[910]: time="2026-08-20T08:23:17.542Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7277 command.oublock=0 command.real_time_ms=166 command.spawn_token_fork_ms=1 command.system_time_ms=97 command.user_time_ms=98 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:23:47.168" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:17.369" grpc.time_ms=173.197 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 425.852249] gitaly[910]: time="2026-08-20T08:23:17.740Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:23:47.538" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:17.738" grpc.time_ms=1.663 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 425.910733] gitaly[910]: time="2026-08-20T08:23:17.799Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4667DMDKYNJ9MA1R14GR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:47.596" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:17.797" grpc.time_ms=1.304 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 425.947463] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:17.824Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"da05ca528d0fa9e098653709","created_at":"2026-08-20T08:21:49.924Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-9a82c9c08a9842a8","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:21:49.935Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-da05ca528d0fa9e098653709: done: 0.66469 sec","job_status":"done","queue_duration_s":87.224752,"scheduling_latency_s":87.224779,"gitaly_calls":3,"gitaly_duration_s":0.186741,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.038023,"redis_read_bytes":457,"redis_write_bytes":28001,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001769,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001833,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.013597,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006054,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14495,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.007859,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001193,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000896,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003053,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.097,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.036,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.04,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.353383,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.5803337,"duration_s":0.66469,"completed_at":"2026-08-20T08:23:17.824Z","load_balancing_strategy":"primary","db_duration_s":0.112773,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2144gitlab # [ 426.025989] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:17.827Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"dad98e1013b7ab69ece8d469","created_at":"2026-08-20T08:23:14.734Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:14.757Z","job_size_bytes":46,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-dad98e1013b7ab69ece8d469: start","job_status":"start","queue_duration_s":3.070092,"scheduling_latency_s":3.07012}2145gitlab # [ 426.044416] gitaly[910]: time="2026-08-20T08:23:17.897Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T14:23:17.885" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:17.885" grpc.time_ms=10.656 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 426.057381] gitaly[910]: time="2026-08-20T08:23:17.926Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:23:47.706" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:17.907" grpc.time_ms=18.746 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2148gitlab # [ 426.097670] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:17.985Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"dad98e1013b7ab69ece8d469","created_at":"2026-08-20T08:23:14.734Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:14.757Z","job_size_bytes":46,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-dad98e1013b7ab69ece8d469: done: 0.157885 sec","job_status":"done","queue_duration_s":3.070092,"scheduling_latency_s":3.07012,"gitaly_calls":2,"gitaly_duration_s":0.035675,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010713,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002245,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001217,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002588,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003576,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065722,"duration_s":0.157885,"completed_at":"2026-08-20T08:23:17.985Z","load_balancing_strategy":"primary","db_duration_s":0.017738,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2149gitlab # [ 426.162118] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:17.987Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37169a058f54cad3f93ede0c","created_at":"2026-08-20T08:23:14.785Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:14.794Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37169a058f54cad3f93ede0c: start","job_status":"start","queue_duration_s":3.193897,"scheduling_latency_s":3.193932}2150gitlab # [ 426.182663] nixbot[3529]: INFO: ::ffff:127.0.0.1:39126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2151gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2152gitlab # [ 426.192942] gitaly[910]: time="2026-08-20T08:23:18.081Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X diskcache=04170d99-6c68-4589-b056-ebf0f3d048ac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:23:18.030" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:18.030" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2153gitlab # [ 426.203521] gitaly[910]: time="2026-08-20T08:23:18.081Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=7 command.system_time_ms=26 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:23:18.030" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:18.030" grpc.time_ms=50.617 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2154gitlab # [ 426.287774] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:18.174Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37169a058f54cad3f93ede0c","created_at":"2026-08-20T08:23:14.785Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:14.794Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37169a058f54cad3f93ede0c: done: 0.186701 sec","job_status":"done","queue_duration_s":3.193897,"scheduling_latency_s":3.193932,"gitaly_calls":1,"gitaly_duration_s":0.055197,"redis_calls":15,"redis_duration_s":0.007108000000000001,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002612,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001782,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00206,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.025,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.049,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13983674,"duration_s":0.186701,"completed_at":"2026-08-20T08:23:18.174Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2155gitlab # [ 426.369678] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:18.178Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d828a8866517caa664c3c69f","created_at":"2026-08-20T08:23:14.992Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:14.996Z","job_size_bytes":23,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d828a8866517caa664c3c69f: start","job_status":"start","queue_duration_s":3.182018,"scheduling_latency_s":3.182065}2156gitlab # [ 426.389154] gitaly[910]: time="2026-08-20T08:23:18.247Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T08:23:48.028" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:18.229" grpc.time_ms=18.199 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 426.405226] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:18.265Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"d828a8866517caa664c3c69f","created_at":"2026-08-20T08:23:14.992Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:14.996Z","job_size_bytes":23,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d828a8866517caa664c3c69f: done: 0.087192 sec","job_status":"done","queue_duration_s":3.182018,"scheduling_latency_s":3.182065,"gitaly_calls":1,"gitaly_duration_s":0.022115,"redis_calls":16,"redis_duration_s":0.006025,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000477,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.00264,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087192,"completed_at":"2026-08-20T08:23:18.265Z","load_balancing_strategy":"primary","db_duration_s":0.005714,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2158gitlab # [ 426.452885] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:18.268Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8181a3d6365771b86edb8fc2","created_at":"2026-08-20T08:23:15.806Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:46c09e58cb1f7127d53239797f0a8647854254f1be188481b2ee4559847e8f8e","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:15.819Z","job_size_bytes":467,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8181a3d6365771b86edb8fc2: start","job_status":"start","queue_duration_s":2.448023,"scheduling_latency_s":2.448061}2159gitlab # [ 426.470298] gitaly[910]: time="2026-08-20T08:23:18.334Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:48.132" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:18.333" grpc.time_ms=1.127 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 426.482754] gitaly[910]: time="2026-08-20T08:23:18.357Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:23:28.029" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:18.339" grpc.time_ms=17.435 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 426.677161] gitaly[910]: time="2026-08-20T08:23:18.564Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:23:48.362" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:18.562" grpc.time_ms=1.376 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 426.715829] gitaly[910]: time="2026-08-20T08:23:18.574Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=35 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:23:48.369" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:18.569" grpc.time_ms=4.301 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 426.872784] gitaly[910]: time="2026-08-20T08:23:18.761Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:28.093" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:18.743" grpc.time_ms=17.094 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2165gitlab # [ 427.248132] nixbot[3529]: INFO: ::ffff:127.0.0.1:39142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2166gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2167gitlab # [ 427.539133] gitaly[910]: time="2026-08-20T08:23:19.427Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=19 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:23:49.198" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:19.399" grpc.time_ms=27.819 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 427.584357] gitaly[910]: time="2026-08-20T08:23:19.453Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0F460EWMJXEQCRDW6GAZ44X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:23:49.230" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:19.430" grpc.time_ms=22.619 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 427.635422] sidekiq-cluster[3479]: {"severity":"WARN","time":"2026-08-20T08:23:19.522Z","class":"CreatePipelineWorker","correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"661aba856ec9c6ff8b7f3dbf60662501aa8a07cf","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"661aba856ec9c6ff8b7f3dbf60662501aa8a07cf","ref":"refs/heads/master"},"retry":0}2170gitlab # [ 427.657592] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:19.540Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"8181a3d6365771b86edb8fc2","created_at":"2026-08-20T08:23:15.806Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:46c09e58cb1f7127d53239797f0a8647854254f1be188481b2ee4559847e8f8e","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:15.819Z","job_size_bytes":467,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-8181a3d6365771b86edb8fc2: done: 1.272494 sec","job_status":"done","queue_duration_s":2.448023,"scheduling_latency_s":2.448061,"gitaly_calls":7,"gitaly_duration_s":0.117184,"redis_calls":51,"redis_duration_s":0.025966,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001618,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.009656,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004929,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.006607,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.06384,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00099434,"duration_s":1.272494,"completed_at":"2026-08-20T08:23:19.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090804,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2171gitlab # [ 427.751011] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:19.544Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"280f8e58-30d1-4257-a650-d8e0b1ceb65a\"}"],"class":"WebHookWorker","jid":"b295859866d2ce4f153e88b1","created_at":"2026-08-20T08:23:16.087Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ccf1d1da18839584b391e821544e67210ce41bc95030b7f2eea1295cf1e7c479","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.096Z","job_size_bytes":1751,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b295859866d2ce4f153e88b1: start","job_status":"start","queue_duration_s":3.448247,"scheduling_latency_s":3.448289}2172gitlab # [ 427.838363] nixbot[3529]: INFO: ::ffff:127.0.0.1:39144 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2173gitlab # [ 427.879675] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:19.766Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"280f8e58-30d1-4257-a650-d8e0b1ceb65a\"}"],"class":"WebHookWorker","jid":"b295859866d2ce4f153e88b1","created_at":"2026-08-20T08:23:16.087Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-9ef62da673d24e71","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ccf1d1da18839584b391e821544e67210ce41bc95030b7f2eea1295cf1e7c479","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.096Z","job_size_bytes":1751,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b295859866d2ce4f153e88b1: done: 0.222293 sec","job_status":"done","queue_duration_s":3.448247,"scheduling_latency_s":3.448289,"redis_calls":19,"redis_duration_s":0.007524,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00185,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000739,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003309,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05561127999999371,"cpu_s":0.141883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00126232,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.222293,"completed_at":"2026-08-20T08:23:19.766Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2174gitlab # [ 427.990869] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:19.770Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"507854fcf53cab1dde6d0e94","created_at":"2026-08-20T08:23:16.352Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-d5fc12a6e808474c","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"37169a058f54cad3f93ede0c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.358Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-507854fcf53cab1dde6d0e94: start","job_status":"start","queue_duration_s":3.411907,"scheduling_latency_s":3.411959}2175gitlab # [ 428.014583] gitaly[910]: time="2026-08-20T08:23:19.834Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B diskcache=09e3d941-c82f-425e-a1d3-c1c0cf4413fa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:23:19.818" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:19.819" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 428.026184] gitaly[910]: time="2026-08-20T08:23:19.835Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T14:23:19.818" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:19.819" grpc.time_ms=15.94 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 428.040330] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:19.879Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"507854fcf53cab1dde6d0e94","created_at":"2026-08-20T08:23:16.352Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-d5fc12a6e808474c","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"37169a058f54cad3f93ede0c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.358Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-507854fcf53cab1dde6d0e94: done: 0.108417 sec","job_status":"done","queue_duration_s":3.411907,"scheduling_latency_s":3.411959,"gitaly_calls":1,"gitaly_duration_s":0.020413,"redis_calls":12,"redis_duration_s":0.006925,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00297,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.02,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.02,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06227148,"duration_s":0.108417,"completed_at":"2026-08-20T08:23:19.878Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2178gitlab # [ 428.087071] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:19.882Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3b0df607fad5ee2250917d9d","created_at":"2026-08-20T08:23:16.585Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-d5fc12a6e808474c","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77fa47ab628e0b7aa7d57682cb10a07a9cea335f13064dbd6db126cf7d506d8d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.591Z","job_size_bytes":467,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3b0df607fad5ee2250917d9d: start","job_status":"start","queue_duration_s":3.290596,"scheduling_latency_s":3.290636}2179gitlab # [ 428.104630] gitaly[910]: time="2026-08-20T08:23:19.926Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:49.724" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:19.924" grpc.time_ms=0.983 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 428.117443] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1632181gitlab # [ 428.119515] gitaly[910]: time="2026-08-20T08:23:19.943Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:23:29.279" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:19.929" grpc.time_ms=12.868 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 428.132655] gitaly[910]: time="2026-08-20T08:23:19.968Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F48YZX3PQQE6QSMBFPBD8N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:19.954" grpc.time_ms=13.628 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2183gitlab # [ 428.145931] gitaly[910]: time="2026-08-20T08:23:19.994Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:23:49.792" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:19.992" grpc.time_ms=1.762 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 428.158644] gitaly[910]: time="2026-08-20T08:23:20.004Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=203 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T08:23:49.798" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:19.999" grpc.time_ms=5.215 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2185gitlab # [ 428.174980] gitaly[910]: time="2026-08-20T08:23:20.055Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:30.036" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:20.036" grpc.time_ms=18.66 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2186gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2187gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.07 seconds)2188gitlab # [ 428.315908] nixbot[3529]: INFO: ::ffff:127.0.0.1:39148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2189gitlab # [ 428.350782] gitaly[910]: time="2026-08-20T08:23:20.239Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F48Z53SRCGVXZT91F9FEFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:20.219" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2190gitlab # [ 428.364141] gitaly[910]: time="2026-08-20T08:23:20.239Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F48Z53SRCGVXZT91F9FEFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:20.219" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2191gitlab # [ 428.380055] gitlab-workhorse[825]: time="2026-08-20T08:23:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672192gitlab # [ 428.382079] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 2682193gitlab # [ 428.384128] gitaly[910]: time="2026-08-20T08:23:20.239Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0F48Z53SRCGVXZT91F9FEFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:20.219" grpc.time_ms=20.589 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2194gitlab # [ 428.412866] nixbot[3529]: {"ts": "2026-08-20T08:23:20.301Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2195gitlab # [ 428.593170] gitaly[910]: time="2026-08-20T08:23:20.481Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:50.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:20.480" grpc.time_ms=1.138 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 428.860231] gitaly[910]: time="2026-08-20T08:23:20.746Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T08:23:50.521" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:20.722" grpc.time_ms=23.734 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 428.899547] gitaly[910]: time="2026-08-20T08:23:20.760Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:30.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:20.739" grpc.time_ms=20.615 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab # [ 428.923191] sidekiq-cluster[3479]: {"severity":"WARN","time":"2026-08-20T08:23:20.787Z","class":"CreatePipelineWorker","correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"661aba856ec9c6ff8b7f3dbf60662501aa8a07cf","after":"76fc2c714d939d1c6b4fb858e107c3c988ec740c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"76fc2c714d939d1c6b4fb858e107c3c988ec740c","ref":"refs/heads/master"},"retry":0}2199gitlab # [ 428.935436] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:20.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3b0df607fad5ee2250917d9d","created_at":"2026-08-20T08:23:16.585Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-d5fc12a6e808474c","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77fa47ab628e0b7aa7d57682cb10a07a9cea335f13064dbd6db126cf7d506d8d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.591Z","job_size_bytes":467,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3b0df607fad5ee2250917d9d: done: 0.914004 sec","job_status":"done","queue_duration_s":3.290596,"scheduling_latency_s":3.290636,"gitaly_calls":7,"gitaly_duration_s":0.105452,"redis_calls":33,"redis_duration_s":0.007282,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001149,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003564,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.785101,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.914004,"completed_at":"2026-08-20T08:23:20.795Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024694,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2200gitlab # [ 429.006616] gitaly[910]: time="2026-08-20T08:23:20.770Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F464N0GJ2HV6KZ2B91JW9B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T08:23:50.548" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:20.748" grpc.time_ms=21.219 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2201gitlab # [ 429.023309] nixbot[3529]: INFO: ::ffff:127.0.0.1:39156 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2202gitlab # [ 429.025071] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:20.799Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"5abb8718-42a9-4552-8efc-5baea9e12db5\"}"],"class":"WebHookWorker","jid":"047adcf2aa53aa37d3aca155","created_at":"2026-08-20T08:23:16.624Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-d5fc12a6e808474c","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e0590f2fd38403a2a5ea3d4392c9ee725f0b9f5e032686f3ddff01b1e392676d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.629Z","job_size_bytes":1749,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-047adcf2aa53aa37d3aca155: start","job_status":"start","queue_duration_s":4.17016,"scheduling_latency_s":4.170196}2203gitlab # [ 429.045487] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:20.873Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"5abb8718-42a9-4552-8efc-5baea9e12db5\"}"],"class":"WebHookWorker","jid":"047adcf2aa53aa37d3aca155","created_at":"2026-08-20T08:23:16.624Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-d5fc12a6e808474c","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e0590f2fd38403a2a5ea3d4392c9ee725f0b9f5e032686f3ddff01b1e392676d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:16.629Z","job_size_bytes":1749,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-047adcf2aa53aa37d3aca155: done: 0.07465 sec","job_status":"done","queue_duration_s":4.17016,"scheduling_latency_s":4.170196,"redis_calls":14,"redis_duration_s":0.00368,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000509,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001958,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.012294240000016998,"cpu_s":0.036578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.07465,"completed_at":"2026-08-20T08:23:20.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002608,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2204gitlab # [ 429.093468] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:20.877Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bf8e6a0e50d1a20217e47b18","created_at":"2026-08-20T08:23:17.344Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.352Z","job_size_bytes":23,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bf8e6a0e50d1a20217e47b18: start","job_status":"start","queue_duration_s":3.524575,"scheduling_latency_s":3.524605}2205gitlab # [ 429.110322] gitaly[910]: time="2026-08-20T08:23:20.968Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F4901RN32JWREPSQDRT54M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:20.956" grpc.time_ms=12.779 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2206gitlab # [ 429.123975] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 6202207gitlab # [ 429.126672] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 802208gitlab # [ 429.129891] nixbot[3529]: {"ts": "2026-08-20T08:23:20.945Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf \"HTTP/1.1 201 Created\""}2209gitlab # [ 429.132707] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:20.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"bf8e6a0e50d1a20217e47b18","created_at":"2026-08-20T08:23:17.344Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.352Z","job_size_bytes":23,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-bf8e6a0e50d1a20217e47b18: done: 0.108406 sec","job_status":"done","queue_duration_s":3.524575,"scheduling_latency_s":3.524605,"redis_calls":10,"redis_duration_s":0.0059,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000399,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030156,"duration_s":0.108406,"completed_at":"2026-08-20T08:23:20.985Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018605,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2210gitlab # [ 429.177210] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:20.987Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b6ebc2769daf1c2ebffcfc32","created_at":"2026-08-20T08:23:17.552Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.564Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b6ebc2769daf1c2ebffcfc32: start","job_status":"start","queue_duration_s":3.423052,"scheduling_latency_s":3.423073}2211gitlab # [ 429.193833] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.023Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b6ebc2769daf1c2ebffcfc32","created_at":"2026-08-20T08:23:17.552Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.564Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b6ebc2769daf1c2ebffcfc32: done: 0.035941 sec","job_status":"done","queue_duration_s":3.423052,"scheduling_latency_s":3.423073,"redis_calls":10,"redis_duration_s":0.001393,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025138,"duration_s":0.035941,"completed_at":"2026-08-20T08:23:21.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 429.238213] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.024Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ad3a3734cd12e5c4d5b1e4d0","created_at":"2026-08-20T08:23:17.588Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.603Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ad3a3734cd12e5c4d5b1e4d0: start","job_status":"start","queue_duration_s":3.420954,"scheduling_latency_s":3.420975}2213gitlab # [ 429.254285] gitlab-workhorse[825]: time="2026-08-20T08:23:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672214gitlab # [ 429.256103] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 792215gitlab # [ 429.257946] gitaly[910]: time="2026-08-20T08:23:21.050Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F4904D68XYBA0VV3PK7DRF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.038" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2216gitlab # [ 429.268199] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.066Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ad3a3734cd12e5c4d5b1e4d0","created_at":"2026-08-20T08:23:17.588Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.603Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ad3a3734cd12e5c4d5b1e4d0: done: 0.042318 sec","job_status":"done","queue_duration_s":3.420954,"scheduling_latency_s":3.420975,"redis_calls":10,"redis_duration_s":0.002713,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000676,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001524,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028485,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049324,"duration_s":0.042318,"completed_at":"2026-08-20T08:23:21.066Z","load_balancing_strategy":"primary","db_duration_s":0.005752,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2217gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2218gitlab # [ 429.311686] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.068Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b2baf4acf1af5f54cfc4f3e6","created_at":"2026-08-20T08:23:17.630Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.641Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b2baf4acf1af5f54cfc4f3e6: start","job_status":"start","queue_duration_s":3.427167,"scheduling_latency_s":3.427188}2219gitlab # [ 429.327103] gitaly[910]: time="2026-08-20T08:23:21.050Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4904D68XYBA0VV3PK7DRF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.038" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2220gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.06 seconds)2221gitlab # [ 429.339799] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"b2baf4acf1af5f54cfc4f3e6","created_at":"2026-08-20T08:23:17.630Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.641Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-b2baf4acf1af5f54cfc4f3e6: done: 0.050373 sec","job_status":"done","queue_duration_s":3.427167,"scheduling_latency_s":3.427188,"redis_calls":13,"redis_duration_s":0.008235,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000359,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004831,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002659,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029938,"duration_s":0.050373,"completed_at":"2026-08-20T08:23:21.118Z","load_balancing_strategy":"primary","db_duration_s":0.005939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2222gitlab # [ 429.386687] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d3ce3fb26fba1db4d7240c2a","created_at":"2026-08-20T08:23:17.642Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.651Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d3ce3fb26fba1db4d7240c2a: start","job_status":"start","queue_duration_s":3.474727,"scheduling_latency_s":3.474749}2223gitlab # [ 429.403511] gitaly[910]: time="2026-08-20T08:23:21.050Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4904D68XYBA0VV3PK7DRF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.038" grpc.time_ms=12.804 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2224gitlab # [ 429.417942] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 982225gitlab # [ 429.420497] nixbot[3529]: INFO: ::ffff:127.0.0.1:39170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2226gitlab # [ 429.422509] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"d3ce3fb26fba1db4d7240c2a","created_at":"2026-08-20T08:23:17.642Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.651Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-d3ce3fb26fba1db4d7240c2a: done: 0.047904 sec","job_status":"done","queue_duration_s":3.474727,"scheduling_latency_s":3.474749,"redis_calls":10,"redis_duration_s":0.005488,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045706,"duration_s":0.047904,"completed_at":"2026-08-20T08:23:21.173Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2227gitlab # [ 429.467278] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.175Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fb2d33944ced1e41060a5ff9","created_at":"2026-08-20T08:23:17.652Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.661Z","job_size_bytes":19,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fb2d33944ced1e41060a5ff9: start","job_status":"start","queue_duration_s":3.513171,"scheduling_latency_s":3.513189}2228gitlab # [ 429.483502] gitaly[910]: time="2026-08-20T08:23:21.216Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M0F4908Y4VN8T5GXEH7B3EZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.201" grpc.time_ms=14.875 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2229gitlab # [ 429.496969] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1712230gitlab # [ 429.499013] gitlab-workhorse[825]: time="2026-08-20T08:23:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672231gitlab # [ 429.500912] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1172232gitlab # [ 429.502816] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.225Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fb2d33944ced1e41060a5ff9","created_at":"2026-08-20T08:23:17.652Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.661Z","job_size_bytes":19,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fb2d33944ced1e41060a5ff9: done: 0.050749 sec","job_status":"done","queue_duration_s":3.513171,"scheduling_latency_s":3.513189,"redis_calls":11,"redis_duration_s":0.009979,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001736,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006381,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001862,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004387,"duration_s":0.050749,"completed_at":"2026-08-20T08:23:21.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012905,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2233gitlab # [ 429.547970] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.227Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c091580a6743f08e6721be28","created_at":"2026-08-20T08:23:17.666Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.674Z","job_size_bytes":66,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c091580a6743f08e6721be28: start","job_status":"start","queue_duration_s":3.5538,"scheduling_latency_s":3.553819}2234gitlab # [ 429.565635] gitaly[910]: time="2026-08-20T08:23:21.228Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4903PVG28ZMX82QKX42G4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:51.023" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:21.224" grpc.time_ms=3.85 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2235gitlab # [ 429.578792] nixbot[3529]: {"ts": "2026-08-20T08:23:21.399Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf \"HTTP/1.1 201 Created\""}2236gitlab # [ 429.582238] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.277Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c091580a6743f08e6721be28","created_at":"2026-08-20T08:23:17.666Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.674Z","job_size_bytes":66,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c091580a6743f08e6721be28: done: 0.049606 sec","job_status":"done","queue_duration_s":3.5538,"scheduling_latency_s":3.553819,"redis_calls":10,"redis_duration_s":0.002832,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00146,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031664,"duration_s":0.049606,"completed_at":"2026-08-20T08:23:21.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2237gitlab # [ 429.631048] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.280Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"31340d3d0fac10b82a1d03ab","created_at":"2026-08-20T08:23:17.675Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.682Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-31340d3d0fac10b82a1d03ab: start","job_status":"start","queue_duration_s":3.597666,"scheduling_latency_s":3.597685}2238gitlab # [ 429.647338] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4472239gitlab # [ 429.649963] gitlab-workhorse[825]: time="2026-08-20T08:23:21Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162240gitlab # [ 429.651787] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1282241gitlab # [ 429.653972] gitaly[910]: time="2026-08-20T08:23:21.303Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=6 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F4903PVG28ZMX82QKX42G4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:31.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:21.293" grpc.time_ms=9.398 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 429.667934] nix-daemon[3744]: accepted connection from pid 4327, user nixbot2243gitlab # [ 429.669091] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.343Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"31340d3d0fac10b82a1d03ab","created_at":"2026-08-20T08:23:17.675Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.682Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-31340d3d0fac10b82a1d03ab: done: 0.063221 sec","job_status":"done","queue_duration_s":3.597666,"scheduling_latency_s":3.597685,"redis_calls":10,"redis_duration_s":0.006784,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001017,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004923,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00755994,"duration_s":0.063221,"completed_at":"2026-08-20T08:23:21.343Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011773,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 429.714253] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.346Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c82e4a16ce9c07c7cc26c31b","created_at":"2026-08-20T08:23:17.691Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.697Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c82e4a16ce9c07c7cc26c31b: start","job_status":"start","queue_duration_s":3.649305,"scheduling_latency_s":3.649326}2245gitlab # [ 429.731070] gitaly[910]: time="2026-08-20T08:23:21.313Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0F490A0GMK6SB205XVJNP7X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.303" grpc.time_ms=9.657 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2246gitlab # [ 429.744502] gitaly[910]: time="2026-08-20T08:23:21.335Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F490C2E2AV54EJKC3738F1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.324" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2247gitlab # [ 429.754603] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.410Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c82e4a16ce9c07c7cc26c31b","created_at":"2026-08-20T08:23:17.691Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.697Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c82e4a16ce9c07c7cc26c31b: done: 0.063163 sec","job_status":"done","queue_duration_s":3.649305,"scheduling_latency_s":3.649326,"redis_calls":10,"redis_duration_s":0.013764,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00558,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054804,"duration_s":0.063163,"completed_at":"2026-08-20T08:23:21.410Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2248gitlab # [ 429.799880] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.422Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"66ea0d82547df12ca1b06ff7","created_at":"2026-08-20T08:23:17.698Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.703Z","job_size_bytes":6,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-66ea0d82547df12ca1b06ff7: start","job_status":"start","queue_duration_s":3.719167,"scheduling_latency_s":3.719193}2249gitlab # [ 429.816045] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2342250gitlab # [ 429.818579] gitaly[910]: time="2026-08-20T08:23:21.336Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490C2E2AV54EJKC3738F1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.324" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2251gitlab # [ 429.832578] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"66ea0d82547df12ca1b06ff7","created_at":"2026-08-20T08:23:17.698Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.703Z","job_size_bytes":6,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-66ea0d82547df12ca1b06ff7: done: 0.046536 sec","job_status":"done","queue_duration_s":3.719167,"scheduling_latency_s":3.719193,"redis_calls":10,"redis_duration_s":0.014774,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002803,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00332,"duration_s":0.046536,"completed_at":"2026-08-20T08:23:21.469Z","load_balancing_strategy":"primary","db_duration_s":0.005701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2252gitlab # [ 429.876516] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.471Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e3e7f6f60ffc0a72a83cc2af","created_at":"2026-08-20T08:23:17.704Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.709Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e3e7f6f60ffc0a72a83cc2af: start","job_status":"start","queue_duration_s":3.761477,"scheduling_latency_s":3.761498}2253gitlab # [ 429.892610] nixbot[3529]: {"ts": "2026-08-20T08:23:21.643Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/661aba856ec9c6ff8b7f3dbf60662501aa8a07cf \"HTTP/1.1 201 Created\""}2254gitlab # [ 429.895459] gitaly[910]: time="2026-08-20T08:23:21.336Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490C2E2AV54EJKC3738F1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.324" grpc.time_ms=11.741 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2255gitlab # [ 429.911063] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.516Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e3e7f6f60ffc0a72a83cc2af","created_at":"2026-08-20T08:23:17.704Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.709Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e3e7f6f60ffc0a72a83cc2af: done: 0.045574 sec","job_status":"done","queue_duration_s":3.761477,"scheduling_latency_s":3.761498,"redis_calls":10,"redis_duration_s":0.004051,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026412,"duration_s":0.045574,"completed_at":"2026-08-20T08:23:21.516Z","load_balancing_strategy":"primary","db_duration_s":0.00794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2256gitlab # [ 429.955607] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.518Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"580dd0a4434da4c70fb481f4","created_at":"2026-08-20T08:23:17.717Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.723Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-580dd0a4434da4c70fb481f4: start","job_status":"start","queue_duration_s":3.795762,"scheduling_latency_s":3.795784}2257gitlab # [ 429.973673] gitaly[910]: time="2026-08-20T08:23:21.455Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F490FFKTNMSFP4MHETZATF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.421" pid=910 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2258gitlab # [ 429.984147] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.585Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"580dd0a4434da4c70fb481f4","created_at":"2026-08-20T08:23:17.717Z","trace_propagation_headers":{"sentry-trace":"48b64b688b854431a8a31e89250a71bb-e5dd9d217efd4c1a","baggage":"sentry-trace_id=48b64b688b854431a8a31e89250a71bb,sentry-release=Unknown"},"correlation_id":"01M0F4667DMDKYNJ9MA1R14GR8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.723Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-580dd0a4434da4c70fb481f4: done: 0.066694 sec","job_status":"done","queue_duration_s":3.795762,"scheduling_latency_s":3.795784,"redis_calls":14,"redis_duration_s":0.001849,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002381,"duration_s":0.066694,"completed_at":"2026-08-20T08:23:21.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2259gitlab # [ 430.028650] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.587Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8d81325d1b35adf12afb9e12","created_at":"2026-08-20T08:23:17.945Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-d576ae91557b4d84","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.957Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8d81325d1b35adf12afb9e12: start","job_status":"start","queue_duration_s":3.630023,"scheduling_latency_s":3.630042}2260gitlab # [ 430.044586] gitaly[910]: time="2026-08-20T08:23:21.455Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490FFKTNMSFP4MHETZATF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.421" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2261gitlab # [ 430.059257] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8d81325d1b35adf12afb9e12","created_at":"2026-08-20T08:23:17.945Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-d576ae91557b4d84","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:17.957Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8d81325d1b35adf12afb9e12: done: 0.092382 sec","job_status":"done","queue_duration_s":3.630023,"scheduling_latency_s":3.630042,"redis_calls":19,"redis_duration_s":0.007396,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002458,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000572,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002804,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001562,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":8,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01363422,"duration_s":0.092382,"completed_at":"2026-08-20T08:23:21.679Z","load_balancing_strategy":"primary","db_duration_s":0.016762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2262gitlab # [ 430.106901] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.681Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b295859866d2ce4f153e88b1"],"class":"WebHooks::LogExecutionWorker","jid":"986eb2b2cf3561dba4a061e5","created_at":"2026-08-20T08:23:19.731Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-8e6546b98d124adf","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aae8d4ed4f3ddc90376450de31d68063bb74ec3f787b20300e904fd694a7d499","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:19.744Z","job_size_bytes":2593,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-986eb2b2cf3561dba4a061e5: start","job_status":"start","queue_duration_s":1.936619,"scheduling_latency_s":1.936641}2263gitlab # [ 430.124774] gitaly[910]: time="2026-08-20T08:23:21.455Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490FFKTNMSFP4MHETZATF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:21.421" grpc.time_ms=33.875 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2264gitlab # [ 430.139871] nixbot[3529]: {"ts": "2026-08-20T08:23:21.961Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c \"HTTP/1.1 201 Created\""}2265gitlab # [ 430.142833] nixbot[3529]: {"ts": "2026-08-20T08:23:21.969Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-76fc2c714d93-3"}2266gitlab # [ 430.145241] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.730Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b295859866d2ce4f153e88b1"],"class":"WebHooks::LogExecutionWorker","jid":"986eb2b2cf3561dba4a061e5","created_at":"2026-08-20T08:23:19.731Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-8e6546b98d124adf","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aae8d4ed4f3ddc90376450de31d68063bb74ec3f787b20300e904fd694a7d499","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:19.744Z","job_size_bytes":2593,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-986eb2b2cf3561dba4a061e5: done: 0.049236 sec","job_status":"done","queue_duration_s":1.936619,"scheduling_latency_s":1.936641,"redis_calls":10,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00038,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219,"duration_s":0.049236,"completed_at":"2026-08-20T08:23:21.730Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 430.191906] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.732Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","047adcf2aa53aa37d3aca155"],"class":"WebHooks::LogExecutionWorker","jid":"e7917f442cd18dd4656d9568","created_at":"2026-08-20T08:23:20.859Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-409cd9ae361543b6","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3bfde83d4f1d9428e30205396da7fed5d7bbdb93b5c6db87e0d228f522a41875","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:20.864Z","job_size_bytes":2591,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e7917f442cd18dd4656d9568: start","job_status":"start","queue_duration_s":0.867883,"scheduling_latency_s":0.867902}2268gitlab # [ 430.209873] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:21 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4542269gitlab # [ 430.212466] gitaly[910]: time="2026-08-20T08:23:21.493Z" level=info msg="finished unary call with code OK" catfile.duration_ms=17 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=17 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490HZ7MS4HXP7GQESFTJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:51.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:21.475" grpc.time_ms=17.692 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 430.225479] nix-daemon[3744]: accepted connection from pid 4399, user nixbot2271gitlab # [ 430.226439] nix-daemon[3744]: accepted connection from pid 4407, user nixbot2272gitlab # [ 430.227427] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.759Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","047adcf2aa53aa37d3aca155"],"class":"WebHooks::LogExecutionWorker","jid":"e7917f442cd18dd4656d9568","created_at":"2026-08-20T08:23:20.859Z","trace_propagation_headers":{"sentry-trace":"398b376e3c1f4ec6a744c3266dad0ecb-409cd9ae361543b6","baggage":"sentry-trace_id=398b376e3c1f4ec6a744c3266dad0ecb,sentry-release=Unknown"},"correlation_id":"01M0F464N0GJ2HV6KZ2B91JW9B","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3bfde83d4f1d9428e30205396da7fed5d7bbdb93b5c6db87e0d228f522a41875","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:20.864Z","job_size_bytes":2591,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e7917f442cd18dd4656d9568: done: 0.027406 sec","job_status":"done","queue_duration_s":0.867883,"scheduling_latency_s":0.867902,"redis_calls":7,"redis_duration_s":0.001224,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027406,"completed_at":"2026-08-20T08:23:21.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 430.272091] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:21.760Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"763954db7a861697afa8803c","created_at":"2026-08-20T08:23:20.894Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-de6bb1ff2dc34fe9","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:20.906Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-763954db7a861697afa8803c: start","job_status":"start","queue_duration_s":0.853972,"scheduling_latency_s":0.853993}2274gitlab # [ 430.288151] gitaly[910]: time="2026-08-20T08:23:21.573Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F490HZ7MS4HXP7GQESFTJ1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:31.271" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:21.561" grpc.time_ms=11.227 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 430.301640] nixbot[3529]: {"ts": "2026-08-20T08:23:22.119Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-76fc2c714d93-3", "argv0": "bwrap"}2276gitlab # [ 430.303903] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.044Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"763954db7a861697afa8803c","created_at":"2026-08-20T08:23:20.894Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-de6bb1ff2dc34fe9","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:20.906Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3479,"job_status":"rescheduled","message":"PipelineProcessWorker JID-763954db7a861697afa8803c: rescheduled"}2277gitlab # [ 430.319196] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.052Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"763954db7a861697afa8803c","created_at":"2026-08-20T08:23:20.894Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-de6bb1ff2dc34fe9","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:20.906Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-763954db7a861697afa8803c: done: 0.291338 sec","job_status":"done","queue_duration_s":0.853972,"scheduling_latency_s":0.853993,"gitaly_calls":3,"gitaly_duration_s":0.109039,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010883,"redis_read_bytes":150,"redis_write_bytes":18010,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000447,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000767,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002839,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003644,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000268,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001154,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001317,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142198,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.248697,"duration_s":0.291338,"completed_at":"2026-08-20T08:23:22.052Z","load_balancing_strategy":"primary","db_duration_s":0.038519,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2278gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c'2279gitlab # [ 430.372547] gitaly[910]: time="2026-08-20T08:23:21.601Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:51.600" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:21.601" grpc.time_ms=0.703 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2280gitlab # [ 430.385468] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e9c5e267eab21d87065ac7af","created_at":"2026-08-20T08:23:21.659Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-6feeb3ef677942ad","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.669Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e9c5e267eab21d87065ac7af: start","job_status":"start","queue_duration_s":0.384499,"scheduling_latency_s":0.384524}2281gitlab # [ 430.401363] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e9c5e267eab21d87065ac7af","created_at":"2026-08-20T08:23:21.659Z","trace_propagation_headers":{"sentry-trace":"e694599fb25844e4b4759b45cd2ed83a-6feeb3ef677942ad","baggage":"sentry-trace_id=e694599fb25844e4b4759b45cd2ed83a,sentry-release=Unknown"},"correlation_id":"01M0F460EWMJXEQCRDW6GAZ44X","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.669Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e9c5e267eab21d87065ac7af: done: 0.092954 sec","job_status":"done","queue_duration_s":0.384499,"scheduling_latency_s":0.384524,"redis_calls":11,"redis_duration_s":0.002931,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001826,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034534,"duration_s":0.092954,"completed_at":"2026-08-20T08:23:22.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2282gitlab # [ 430.447316] gitaly[910]: time="2026-08-20T08:23:21.623Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T08:23:51.612" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:21.612" grpc.time_ms=10.582 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2283gitlab # [ 430.462466] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.148Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2956e16652862600257f1742","created_at":"2026-08-20T08:23:21.796Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-5fba6b362f6f4087","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.802Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2956e16652862600257f1742: start","job_status":"start","queue_duration_s":0.345681,"scheduling_latency_s":0.3457}2284gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c', in 0.11 seconds)2285(finished: subtest: push delivers the webhook, in 95.35 seconds)2286subtest: eval and build post commit statuses2287gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses2288gitlab # [ 430.479719] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.181Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2956e16652862600257f1742","created_at":"2026-08-20T08:23:21.796Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-5fba6b362f6f4087","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.802Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2956e16652862600257f1742: done: 0.03239 sec","job_status":"done","queue_duration_s":0.345681,"scheduling_latency_s":0.3457,"redis_calls":7,"redis_duration_s":0.001886,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03239,"completed_at":"2026-08-20T08:23:22.180Z","load_balancing_strategy":"primary","db_duration_s":0.00611,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2289gitlab # [ 430.524193] gitaly[910]: time="2026-08-20T08:23:21.656Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:31.178" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:21.648" grpc.time_ms=7.086 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2290gitlab # [ 430.538547] nixbot[3529]: INFO: ::ffff:127.0.0.1:39186 - "GET /api/repos/gitlab/root/test-flake/builds?commit=76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 200 OK2291gitlab # [ 430.540612] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.182Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8575514c54b51c576febc2cd","created_at":"2026-08-20T08:23:21.804Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-5fba6b362f6f4087","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.808Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8575514c54b51c576febc2cd: start","job_status":"start","queue_duration_s":0.37451,"scheduling_latency_s":0.374531}2292gitlab # [ 430.558696] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.246Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"8575514c54b51c576febc2cd","created_at":"2026-08-20T08:23:21.804Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-5fba6b362f6f4087","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.808Z","job_size_bytes":65,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-8575514c54b51c576febc2cd: done: 0.063676 sec","job_status":"done","queue_duration_s":0.37451,"scheduling_latency_s":0.374531,"redis_calls":10,"redis_duration_s":0.00403,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063676,"completed_at":"2026-08-20T08:23:22.246Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2293gitlab # [ 430.603170] gitaly[910]: time="2026-08-20T08:23:21.684Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T08:23:31.213" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:21.683" grpc.time_ms=0.318 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2294gitlab # [ 430.614538] nix-daemon[3744]: accepted connection from pid 4421, user nixbot2295gitlab # [ 430.615461] nix-daemon[3744]: accepted connection from pid 4435, user nixbot2296gitlab # [ 430.616471] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f053163613c08fccfeafb6bd","created_at":"2026-08-20T08:23:21.830Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.832Z","job_size_bytes":23,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f053163613c08fccfeafb6bd: start","job_status":"start","queue_duration_s":0.415661,"scheduling_latency_s":0.41568}2297gitlab # [ 430.634308] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.294Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"f053163613c08fccfeafb6bd","created_at":"2026-08-20T08:23:21.830Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.832Z","job_size_bytes":23,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-f053163613c08fccfeafb6bd: done: 0.04674 sec","job_status":"done","queue_duration_s":0.415661,"scheduling_latency_s":0.41568,"redis_calls":7,"redis_duration_s":0.0018939999999999999,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000507,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04674,"completed_at":"2026-08-20T08:23:22.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012829,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2298gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses, in 0.20 seconds)2299gitlab # [ 430.678258] gitaly[910]: time="2026-08-20T08:23:21.697Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T08:23:31.217" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:21.688" grpc.time_ms=9.242 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2300gitlab # [ 430.691804] gitaly[910]: time="2026-08-20T08:23:21.749Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:21.748" grpc.time_ms=0.589 pid=910 span.kind=server system=grpc2301gitlab # [ 430.702153] nix-daemon[3744]: accepted connection from pid 4444, user nixbot2302gitlab # [ 430.703120] nix-daemon[3744]: accepted connection from pid 4421, user nixbot2303gitlab # [ 430.704189] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.296Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ec02ea545e52c31cf3749b93","created_at":"2026-08-20T08:23:21.937Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-5fba6b362f6f4087","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.941Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ec02ea545e52c31cf3749b93: start","job_status":"start","queue_duration_s":0.354412,"scheduling_latency_s":0.354432}2304gitlab # [ 430.720077] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.542Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"ec02ea545e52c31cf3749b93","created_at":"2026-08-20T08:23:21.937Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-5fba6b362f6f4087","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.941Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ec02ea545e52c31cf3749b93: done: 0.245876 sec","job_status":"done","queue_duration_s":0.354412,"scheduling_latency_s":0.354432,"gitaly_calls":2,"gitaly_duration_s":0.010499,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011047,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002169,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00095,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000839,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001794,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000439,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000497,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00219,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174043,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.17937024,"duration_s":0.245876,"completed_at":"2026-08-20T08:23:22.542Z","load_balancing_strategy":"primary","db_duration_s":0.048443,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2305gitlab # [ 430.771837] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1322306gitlab # [ 430.774653] gitaly[910]: time="2026-08-20T08:23:21.782Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:21.782" grpc.time_ms=0.409 pid=910 span.kind=server system=grpc2307gitlab # [ 430.784507] gitaly[910]: time="2026-08-20T08:23:21.790Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 diskcache=fbc7bf11-12b1-494c-bba4-2ba6720fe9f9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:23:31.230" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:21.701" pid=910 ref=refs/keep-around/76fc2c714d939d1c6b4fb858e107c3c988ec740c remote_ip="2001:db8:1::1" revision=76fc2c714d939d1c6b4fb858e107c3c988ec740c span.kind=server system=grpc username=root2308gitlab # [ 430.796263] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.543Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3ff2478988250447f425de02","created_at":"2026-08-20T08:23:21.944Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.947Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3ff2478988250447f425de02: start","job_status":"start","queue_duration_s":0.595823,"scheduling_latency_s":0.595845}2309gitlab # [ 430.813293] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.576Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3ff2478988250447f425de02","created_at":"2026-08-20T08:23:21.944Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.947Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3ff2478988250447f425de02: done: 0.03347 sec","job_status":"done","queue_duration_s":0.595823,"scheduling_latency_s":0.595845,"redis_calls":7,"redis_duration_s":0.001355,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03347,"completed_at":"2026-08-20T08:23:22.576Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004186,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2310gitlab # [ 430.857975] gitaly[910]: time="2026-08-20T08:23:21.791Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=77 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5058 command.oublock=8 command.real_time_ms=84 command.spawn_token_fork_ms=0 command.system_time_ms=45 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T08:23:31.230" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T08:23:21.701" grpc.time_ms=89.609 pid=910 ref=refs/keep-around/76fc2c714d939d1c6b4fb858e107c3c988ec740c remote_ip="2001:db8:1::1" revision=76fc2c714d939d1c6b4fb858e107c3c988ec740c span.kind=server system=grpc username=root2311gitlab # [ 430.873147] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8809d9e392a5a42b33364904","created_at":"2026-08-20T08:23:21.955Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.958Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8809d9e392a5a42b33364904: start","job_status":"start","queue_duration_s":0.619886,"scheduling_latency_s":0.619908}2312gitlab # [ 430.889461] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.608Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8809d9e392a5a42b33364904","created_at":"2026-08-20T08:23:21.955Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.958Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8809d9e392a5a42b33364904: done: 0.030304 sec","job_status":"done","queue_duration_s":0.619886,"scheduling_latency_s":0.619908,"redis_calls":7,"redis_duration_s":0.001083,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030304,"completed_at":"2026-08-20T08:23:22.608Z","load_balancing_strategy":"primary","db_duration_s":0.005106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2313gitlab # [ 430.931537] gitaly[910]: time="2026-08-20T08:23:21.794Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:51.794" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:21.794" grpc.time_ms=0.311 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab # [ 430.944304] gitaly[910]: time="2026-08-20T08:23:21.877Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:21.876" grpc.time_ms=0.403 pid=910 span.kind=server system=grpc2315gitlab # [ 430.953891] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.609Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a2198f649d6d5c0f42b7d4c2","created_at":"2026-08-20T08:23:21.967Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.969Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a2198f649d6d5c0f42b7d4c2: start","job_status":"start","queue_duration_s":0.640386,"scheduling_latency_s":0.640406}2316gitlab # [ 430.969962] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.639Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a2198f649d6d5c0f42b7d4c2","created_at":"2026-08-20T08:23:21.967Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.969Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a2198f649d6d5c0f42b7d4c2: done: 0.030154 sec","job_status":"done","queue_duration_s":0.640386,"scheduling_latency_s":0.640406,"redis_calls":10,"redis_duration_s":0.001304,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000321,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030154,"completed_at":"2026-08-20T08:23:22.639Z","load_balancing_strategy":"primary","db_duration_s":0.004117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2317gitlab # [ 431.013597] gitaly[910]: time="2026-08-20T08:23:21.903Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:21.902" grpc.time_ms=1.111 pid=910 span.kind=server system=grpc2318gitlab # [ 431.023293] gitaly[910]: time="2026-08-20T08:23:21.932Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T08:23:21.931" grpc.time_ms=0.841 pid=910 span.kind=server system=grpc2319gitlab # [ 431.033036] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.641Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8d818baab613e28a00e3b4f3","created_at":"2026-08-20T08:23:21.969Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.971Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8d818baab613e28a00e3b4f3: start","job_status":"start","queue_duration_s":0.669262,"scheduling_latency_s":0.669282}2320gitlab # [ 431.050978] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.669Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8d818baab613e28a00e3b4f3","created_at":"2026-08-20T08:23:21.969Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.971Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8d818baab613e28a00e3b4f3: done: 0.028172 sec","job_status":"done","queue_duration_s":0.669262,"scheduling_latency_s":0.669282,"redis_calls":7,"redis_duration_s":0.001564,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028172,"completed_at":"2026-08-20T08:23:22.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2321gitlab # [ 431.094667] gitaly[910]: time="2026-08-20T08:23:21.939Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 diskcache=d970efc7-2dac-4022-a14c-a1e2e3eadc2f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:23:51.638" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:21.838" pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2322gitlab # [ 431.104478] gitaly[910]: time="2026-08-20T08:23:21.939Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=95 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7101 command.oublock=0 command.real_time_ms=95 command.spawn_token_fork_ms=1 command.system_time_ms=56 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T08:23:51.638" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:21.838" grpc.time_ms=100.343 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2323gitlab # [ 431.117705] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.670Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2e83e9a4332810733f3087c3","created_at":"2026-08-20T08:23:21.972Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.975Z","job_size_bytes":19,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2e83e9a4332810733f3087c3: start","job_status":"start","queue_duration_s":0.695823,"scheduling_latency_s":0.695842}2324gitlab # [ 431.134096] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.698Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2e83e9a4332810733f3087c3","created_at":"2026-08-20T08:23:21.972Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.975Z","job_size_bytes":19,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2e83e9a4332810733f3087c3: done: 0.028104 sec","job_status":"done","queue_duration_s":0.695823,"scheduling_latency_s":0.695842,"redis_calls":8,"redis_duration_s":0.002739,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002203,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000536,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028104,"completed_at":"2026-08-20T08:23:22.698Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006184,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2325gitlab # [ 431.177408] gitaly[910]: time="2026-08-20T08:23:21.998Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:23:51.797" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:21.997" grpc.time_ms=1.039 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2326gitlab # [ 431.190219] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.700Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c49b0546ca822eb1b4b39af9","created_at":"2026-08-20T08:23:21.976Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.978Z","job_size_bytes":66,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c49b0546ca822eb1b4b39af9: start","job_status":"start","queue_duration_s":0.722251,"scheduling_latency_s":0.72227}2327gitlab # [ 431.207463] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.725Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c49b0546ca822eb1b4b39af9","created_at":"2026-08-20T08:23:21.976Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.978Z","job_size_bytes":66,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c49b0546ca822eb1b4b39af9: done: 0.025269 sec","job_status":"done","queue_duration_s":0.722251,"scheduling_latency_s":0.72227,"redis_calls":7,"redis_duration_s":0.0019399999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025269,"completed_at":"2026-08-20T08:23:22.725Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2328gitlab # [ 431.252473] gitaly[910]: time="2026-08-20T08:23:22.032Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F48ZG2RF6YQC145T50HRR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:52.030" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:22.031" grpc.time_ms=0.948 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 431.264720] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.727Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"31efa17ffe3d3d5a38daf6f6","created_at":"2026-08-20T08:23:21.978Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.980Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-31efa17ffe3d3d5a38daf6f6: start","job_status":"start","queue_duration_s":0.74634,"scheduling_latency_s":0.746357}2330gitlab # [ 431.281031] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.755Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"31efa17ffe3d3d5a38daf6f6","created_at":"2026-08-20T08:23:21.978Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.980Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-31efa17ffe3d3d5a38daf6f6: done: 0.028568 sec","job_status":"done","queue_duration_s":0.74634,"scheduling_latency_s":0.746357,"redis_calls":7,"redis_duration_s":0.001827,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028568,"completed_at":"2026-08-20T08:23:22.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2331gitlab # [ 431.323731] gitaly[910]: time="2026-08-20T08:23:22.476Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T08:23:52.474" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:22.475" grpc.time_ms=1.708 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 431.336604] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"da9634f670aab0de2716bfe7","created_at":"2026-08-20T08:23:21.981Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.983Z","job_size_bytes":6,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-da9634f670aab0de2716bfe7: start","job_status":"start","queue_duration_s":0.773903,"scheduling_latency_s":0.773922}2333gitlab # [ 431.352458] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"da9634f670aab0de2716bfe7","created_at":"2026-08-20T08:23:21.981Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.983Z","job_size_bytes":6,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-da9634f670aab0de2716bfe7: done: 0.014934 sec","job_status":"done","queue_duration_s":0.773903,"scheduling_latency_s":0.773922,"redis_calls":7,"redis_duration_s":0.001771,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014934,"completed_at":"2026-08-20T08:23:22.772Z","load_balancing_strategy":"primary","db_duration_s":0.000634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2334gitlab # [ 431.394508] gitaly[910]: time="2026-08-20T08:23:22.527Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F491J6VTKAX6F3C1Q5AK88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:52.524" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:22.526" grpc.time_ms=1.095 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2335gitlab # [ 431.407264] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.773Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"012a449fe25d7326899324ba","created_at":"2026-08-20T08:23:21.984Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.985Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-012a449fe25d7326899324ba: start","job_status":"start","queue_duration_s":0.787843,"scheduling_latency_s":0.787861}2336gitlab # [ 431.422876] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.801Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"012a449fe25d7326899324ba","created_at":"2026-08-20T08:23:21.984Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:21.985Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-012a449fe25d7326899324ba: done: 0.027291 sec","job_status":"done","queue_duration_s":0.787843,"scheduling_latency_s":0.787861,"redis_calls":7,"redis_duration_s":0.001839,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027291,"completed_at":"2026-08-20T08:23:22.801Z","load_balancing_strategy":"primary","db_duration_s":0.00647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2337gitlab # [ 431.465724] gitaly[910]: time="2026-08-20T08:23:22.530Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F490N1CFA46TNTRW498XK8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:52.529" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:22.529" grpc.time_ms=0.585 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2338gitlab # [ 431.478106] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.802Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b44b94d7b3c2397da82a26cb","created_at":"2026-08-20T08:23:22.044Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:22.046Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b44b94d7b3c2397da82a26cb: start","job_status":"start","queue_duration_s":0.75604,"scheduling_latency_s":0.756061}2339gitlab # [ 431.493947] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.832Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"b44b94d7b3c2397da82a26cb","created_at":"2026-08-20T08:23:22.044Z","trace_propagation_headers":{"sentry-trace":"b778faa28cac4256bef93afbb5db6d38-e100a63745024922","baggage":"sentry-trace_id=b778faa28cac4256bef93afbb5db6d38,sentry-release=Unknown"},"correlation_id":"01M0F48ZG2RF6YQC145T50HRR9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:22.046Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b44b94d7b3c2397da82a26cb: done: 0.030021 sec","job_status":"done","queue_duration_s":0.75604,"scheduling_latency_s":0.756061,"redis_calls":8,"redis_duration_s":0.0021999999999999997,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000516,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030021,"completed_at":"2026-08-20T08:23:22.832Z","load_balancing_strategy":"primary","db_duration_s":0.00672,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2340gitlab # [ 431.535961] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f434d95f97d08c958f6a979c","created_at":"2026-08-20T08:23:22.446Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-e4a4cfa28f9c4976","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:22.451Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f434d95f97d08c958f6a979c: start","job_status":"start","queue_duration_s":0.382573,"scheduling_latency_s":0.382593}2341gitlab # [ 431.552203] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:22.871Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f434d95f97d08c958f6a979c","created_at":"2026-08-20T08:23:22.446Z","trace_propagation_headers":{"sentry-trace":"c12d5773935046c2a73a97646fe2a6f9-e4a4cfa28f9c4976","baggage":"sentry-trace_id=c12d5773935046c2a73a97646fe2a6f9,sentry-release=Unknown"},"correlation_id":"01M0F490N1CFA46TNTRW498XK8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:22.451Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f434d95f97d08c958f6a979c: done: 0.037382 sec","job_status":"done","queue_duration_s":0.382573,"scheduling_latency_s":0.382593,"redis_calls":7,"redis_duration_s":0.001901,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037382,"completed_at":"2026-08-20T08:23:22.871Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2342gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses2343gitlab # [ 431.881485] gitaly[910]: time="2026-08-20T08:23:23.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F492RK6X66384G3XQFS8VG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:53.767" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:23.768" grpc.time_ms=1.255 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2344gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses, in 0.25 seconds)2345gitlab # [ 431.937135] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1562346gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses2347gitlab # [ 433.099363] gitaly[910]: time="2026-08-20T08:23:24.986Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F493YGZBXVTXBPVKZ9N8H4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:54.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:24.984" grpc.time_ms=1.329 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2348gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses, in 0.21 seconds)2349gitlab # [ 433.148944] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1552350gitlab # [ 433.829914] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:25.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"37e189f42c98a39627c32f2d","created_at":"2026-08-20T08:23:25.690Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09227cc14f5271eb8768c4c4d6eda862","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.713Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-37e189f42c98a39627c32f2d: start","job_status":"start","queue_duration_s":0.003057,"scheduling_latency_s":0.003114}2351gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses2352gitlab # [ 434.169833] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.055Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"37e189f42c98a39627c32f2d","created_at":"2026-08-20T08:23:25.690Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09227cc14f5271eb8768c4c4d6eda862","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.713Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-37e189f42c98a39627c32f2d: done: 0.339648 sec","job_status":"done","queue_duration_s":0.003057,"scheduling_latency_s":0.003114,"redis_calls":13,"redis_duration_s":0.064596,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005698,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.052094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006804,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0035033,"exclusive_lock_hold_duration_s":0.1358849,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.339648,"completed_at":"2026-08-20T08:23:26.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353gitlab # [ 434.262876] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a5da5ed092a52764f4a5ca41","created_at":"2026-08-20T08:23:25.730Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2e0b32ea89b8a3fe76f8b09d1f3b8b6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.742Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a5da5ed092a52764f4a5ca41: start","job_status":"start","queue_duration_s":0.317844,"scheduling_latency_s":0.317898}2354gitlab # [ 434.290353] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a5da5ed092a52764f4a5ca41","created_at":"2026-08-20T08:23:25.730Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2e0b32ea89b8a3fe76f8b09d1f3b8b6","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.742Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a5da5ed092a52764f4a5ca41: done: 0.117393 sec","job_status":"done","queue_duration_s":0.317844,"scheduling_latency_s":0.317898,"redis_calls":11,"redis_duration_s":0.012352,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004241,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00146948,"exclusive_lock_hold_duration_s":0.01987854,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.117393,"completed_at":"2026-08-20T08:23:26.178Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2355gitlab # [ 434.363274] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b460e7efde288c7725848dca","created_at":"2026-08-20T08:23:25.761Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"355d051367a09492a98a3e69df55a0af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.787Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b460e7efde288c7725848dca: start","job_status":"start","queue_duration_s":0.420197,"scheduling_latency_s":0.420244}2356gitlab # [ 434.382787] gitaly[910]: time="2026-08-20T08:23:26.196Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F4954DAEFSFW063AQ2KYWA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:56.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:26.195" grpc.time_ms=1.188 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses, in 0.25 seconds)2358gitlab # [ 434.398221] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1782359gitlab # [ 434.435161] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b460e7efde288c7725848dca","created_at":"2026-08-20T08:23:25.761Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"355d051367a09492a98a3e69df55a0af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.787Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b460e7efde288c7725848dca: done: 0.114833 sec","job_status":"done","queue_duration_s":0.420197,"scheduling_latency_s":0.420244,"redis_calls":11,"redis_duration_s":0.022085,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.009501,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00079,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.114833,"completed_at":"2026-08-20T08:23:26.322Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2360gitlab # [ 434.501475] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3b35e1616012b01f94258da8","created_at":"2026-08-20T08:23:25.825Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adbb6652a8e96841e8e02c323dadc050","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.844Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3b35e1616012b01f94258da8: start","job_status":"start","queue_duration_s":0.487378,"scheduling_latency_s":0.487434}2361gitlab # [ 434.744518] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3b35e1616012b01f94258da8","created_at":"2026-08-20T08:23:25.825Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adbb6652a8e96841e8e02c323dadc050","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.844Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3b35e1616012b01f94258da8: done: 0.299479 sec","job_status":"done","queue_duration_s":0.487378,"scheduling_latency_s":0.487434,"redis_calls":9,"redis_duration_s":0.01171,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002352,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004604,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004754,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.299479,"completed_at":"2026-08-20T08:23:26.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 434.839582] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"32111bb604d436e0b94c1a6a","created_at":"2026-08-20T08:23:25.909Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82142175457f14f07722aa2c60382e8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.930Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-32111bb604d436e0b94c1a6a: start","job_status":"start","queue_duration_s":0.709307,"scheduling_latency_s":0.709355}2363gitlab # [ 434.857839] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.714Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2364gitlab # [ 434.870238] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"32111bb604d436e0b94c1a6a","created_at":"2026-08-20T08:23:25.909Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82142175457f14f07722aa2c60382e8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:25.930Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-32111bb604d436e0b94c1a6a: done: 0.117407 sec","job_status":"done","queue_duration_s":0.709307,"scheduling_latency_s":0.709355,"redis_calls":9,"redis_duration_s":0.019579,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00328,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.117407,"completed_at":"2026-08-20T08:23:26.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 434.940497] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:26.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5f6021c3471ebcafd3c13a74","created_at":"2026-08-20T08:23:25.947Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1b71605c66da94ce1e7ece7002da69b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:23:25.971Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5f6021c3471ebcafd3c13a74: start","job_status":"start","queue_duration_s":0.814927,"scheduling_latency_s":0.814975}2366gitlab # [ 435.125530] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5f6021c3471ebcafd3c13a74","created_at":"2026-08-20T08:23:25.947Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1b71605c66da94ce1e7ece7002da69b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T08:23:25.971Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5f6021c3471ebcafd3c13a74: done: 0.226697 sec","job_status":"done","queue_duration_s":0.814927,"scheduling_latency_s":0.814975,"redis_calls":9,"redis_duration_s":0.049527,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00422,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.041924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.226697,"completed_at":"2026-08-20T08:23:27.012Z","load_balancing_strategy":"primary","db_duration_s":0.041546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 435.217809] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7f759124db51c984da7ef91a","created_at":"2026-08-20T08:23:26.025Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f227d9c3b470e0f182632d75cbc0b24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.051Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7f759124db51c984da7ef91a: start","job_status":"start","queue_duration_s":0.965149,"scheduling_latency_s":0.9652}2368gitlab # [ 435.236130] gitaly[910]: time="2026-08-20T08:23:27.044Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F495YJXBYNKDGASAPMYEA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:57.040" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:27.042" grpc.time_ms=1.685 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2369gitlab # [ 435.250064] gitaly[910]: time="2026-08-20T08:23:27.129Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0F495YJXBYNKDGASAPMYEA6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:37.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:27.114" grpc.time_ms=13.847 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2370gitlab # [ 435.263850] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7f759124db51c984da7ef91a","created_at":"2026-08-20T08:23:26.025Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f227d9c3b470e0f182632d75cbc0b24","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.051Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7f759124db51c984da7ef91a: done: 0.134299 sec","job_status":"done","queue_duration_s":0.965149,"scheduling_latency_s":0.9652,"redis_calls":11,"redis_duration_s":0.00681,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003568,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002211,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00148546,"exclusive_lock_hold_duration_s":0.03813274,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.134299,"completed_at":"2026-08-20T08:23:27.151Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 435.308407] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5e3731ba061d3ad45b3b570f","created_at":"2026-08-20T08:23:26.096Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d47847266794f6ccee8046779bf047f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.118Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5e3731ba061d3ad45b3b570f: start","job_status":"start","queue_duration_s":1.036066,"scheduling_latency_s":1.036109}2372gitlab # [ 435.327310] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5e3731ba061d3ad45b3b570f","created_at":"2026-08-20T08:23:26.096Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d47847266794f6ccee8046779bf047f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.118Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5e3731ba061d3ad45b3b570f: done: 0.060294 sec","job_status":"done","queue_duration_s":1.036066,"scheduling_latency_s":1.036109,"redis_calls":12,"redis_duration_s":0.004149,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002087,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01729694,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.060294,"completed_at":"2026-08-20T08:23:27.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005022,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2373gitlab # [ 435.381567] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3202374gitlab # [ 435.384741] nixbot[3529]: {"ts": "2026-08-20T08:23:27.258Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c \"HTTP/1.1 201 Created\""}2375gitlab # [ 435.387637] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.217Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bff88839a8af9b4d5126ff96","created_at":"2026-08-20T08:23:26.153Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36091ae251a3afb256fb2e31cd47e218","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.175Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bff88839a8af9b4d5126ff96: start","job_status":"start","queue_duration_s":1.04146,"scheduling_latency_s":1.041494}2376gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses2377gitlab # [ 435.404173] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.291Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"bff88839a8af9b4d5126ff96","created_at":"2026-08-20T08:23:26.153Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36091ae251a3afb256fb2e31cd47e218","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.175Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-bff88839a8af9b4d5126ff96: done: 0.07471 sec","job_status":"done","queue_duration_s":1.04146,"scheduling_latency_s":1.041494,"redis_calls":9,"redis_duration_s":0.00232,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.07471,"completed_at":"2026-08-20T08:23:27.291Z","load_balancing_strategy":"primary","db_duration_s":0.035683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2378gitlab # [ 435.445829] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"af4e1c78815415aa2ba56b73","created_at":"2026-08-20T08:23:26.204Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7fe201e1e16d64f122d98fe512eee5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.229Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-af4e1c78815415aa2ba56b73: start","job_status":"start","queue_duration_s":1.064805,"scheduling_latency_s":1.06484}2379gitlab # [ 435.460328] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.318Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2380gitlab # [ 435.463491] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"af4e1c78815415aa2ba56b73","created_at":"2026-08-20T08:23:26.204Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7fe201e1e16d64f122d98fe512eee5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.229Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-af4e1c78815415aa2ba56b73: done: 0.048442 sec","job_status":"done","queue_duration_s":1.064805,"scheduling_latency_s":1.06484,"redis_calls":9,"redis_duration_s":0.003189,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000711,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048442,"completed_at":"2026-08-20T08:23:27.342Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2381gitlab # [ 435.506246] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"3b719ee8ed2fa52e41bea856","created_at":"2026-08-20T08:23:26.261Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64e169709374f52e347779cbdf697fc1","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.287Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-3b719ee8ed2fa52e41bea856: start","job_status":"start","queue_duration_s":1.057927,"scheduling_latency_s":1.057966}2382gitlab # [ 435.519163] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"3b719ee8ed2fa52e41bea856","created_at":"2026-08-20T08:23:26.261Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"64e169709374f52e347779cbdf697fc1","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.287Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-3b719ee8ed2fa52e41bea856: done: 0.050591 sec","job_status":"done","queue_duration_s":1.057927,"scheduling_latency_s":1.057966,"redis_calls":12,"redis_duration_s":0.0033020000000000002,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00075434,"exclusive_lock_hold_duration_s":0.01431732,"duration_s":0.050591,"completed_at":"2026-08-20T08:23:27.395Z","load_balancing_strategy":"primary","db_duration_s":0.00647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2383gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses, in 0.17 seconds)2384gitlab # [ 435.561900] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.397Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f75279a68d32e0d925543c00","created_at":"2026-08-20T08:23:26.298Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa038f4d62f8b450259a699f68eb7966","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.326Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f75279a68d32e0d925543c00: start","job_status":"start","queue_duration_s":1.070969,"scheduling_latency_s":1.070994}2385gitlab # [ 435.575505] gitaly[910]: time="2026-08-20T08:23:27.362Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F49697HS698HZC50DWDXX6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:57.061" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:27.362" grpc.time_ms=0.573 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2386gitlab # [ 435.588999] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 1032387gitlab # [ 435.591581] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1952388gitlab # [ 435.594284] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f75279a68d32e0d925543c00","created_at":"2026-08-20T08:23:26.298Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa038f4d62f8b450259a699f68eb7966","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.326Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f75279a68d32e0d925543c00: done: 0.059742 sec","job_status":"done","queue_duration_s":1.070969,"scheduling_latency_s":1.070994,"redis_calls":18,"redis_duration_s":0.007345,"redis_read_bytes":20,"redis_write_bytes":4694,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001433,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000313,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002049,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00355,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059742,"completed_at":"2026-08-20T08:23:27.457Z","load_balancing_strategy":"primary","db_duration_s":0.003125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2389gitlab # [ 435.636931] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d5004c3597846399865bbac5","created_at":"2026-08-20T08:23:26.372Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2208d617d927a5df9cc01107f9cd7958","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.382Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d5004c3597846399865bbac5: start","job_status":"start","queue_duration_s":1.076378,"scheduling_latency_s":1.076402}2390gitlab # [ 435.651694] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.473Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2391gitlab # [ 435.655721] nixbot[3529]: {"ts": "2026-08-20T08:23:27.464Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c \"HTTP/1.1 201 Created\""}2392gitlab # [ 435.658666] gitaly[910]: time="2026-08-20T08:23:27.413Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F496BHW4ZK9VY7XCYW6X0M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:57.412" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:27.412" grpc.time_ms=0.669 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2393gitlab # [ 435.671605] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d5004c3597846399865bbac5","created_at":"2026-08-20T08:23:26.372Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2208d617d927a5df9cc01107f9cd7958","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.382Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d5004c3597846399865bbac5: done: 0.025248 sec","job_status":"done","queue_duration_s":1.076378,"scheduling_latency_s":1.076402,"redis_calls":9,"redis_duration_s":0.0017729999999999998,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000358,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025248,"completed_at":"2026-08-20T08:23:27.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2394gitlab # [ 435.714094] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"80eb503b2933a49dd1b02446","created_at":"2026-08-20T08:23:26.552Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"983988f528fffd8a9936a9dd88f4f3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.571Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-80eb503b2933a49dd1b02446: start","job_status":"start","queue_duration_s":0.913249,"scheduling_latency_s":0.913272}2395gitlab # [ 435.727639] gitaly[910]: time="2026-08-20T08:23:27.413Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=7 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0F49697HS698HZC50DWDXX6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:37.273" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:27.403" grpc.time_ms=10.159 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2396gitlab # [ 435.741255] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"80eb503b2933a49dd1b02446","created_at":"2026-08-20T08:23:26.552Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"983988f528fffd8a9936a9dd88f4f3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.571Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-80eb503b2933a49dd1b02446: done: 0.030556 sec","job_status":"done","queue_duration_s":0.913249,"scheduling_latency_s":0.913272,"redis_calls":12,"redis_duration_s":0.002526,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000279,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001429,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045834,"exclusive_lock_hold_duration_s":0.009380580000000001,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.030556,"completed_at":"2026-08-20T08:23:27.515Z","load_balancing_strategy":"primary","db_duration_s":0.004156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2397gitlab # [ 435.785708] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.517Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b7fbf2add067e9fbaca90186","created_at":"2026-08-20T08:23:26.588Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"264a1227750fa2cb57ac25ebd41343ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:23:26.610Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b7fbf2add067e9fbaca90186: start","job_status":"start","queue_duration_s":0.906714,"scheduling_latency_s":0.906737}2398gitlab # [ 435.799229] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.531Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2399gitlab # [ 435.802629] gitaly[910]: time="2026-08-20T08:23:27.547Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F496FMQSRMNXV5M1GE933M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:57.545" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:27.546" grpc.time_ms=0.666 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2400gitlab # [ 435.815217] nixbot[3529]: {"ts": "2026-08-20T08:23:27.661Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c \"HTTP/1.1 201 Created\""}2401gitlab # [ 435.818101] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b7fbf2add067e9fbaca90186","created_at":"2026-08-20T08:23:26.588Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"264a1227750fa2cb57ac25ebd41343ce","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T08:23:26.610Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b7fbf2add067e9fbaca90186: done: 0.023122 sec","job_status":"done","queue_duration_s":0.906714,"scheduling_latency_s":0.906737,"redis_calls":9,"redis_duration_s":0.001437,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000323,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023122,"completed_at":"2026-08-20T08:23:27.540Z","load_balancing_strategy":"primary","db_duration_s":0.001289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 435.859559] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"29f1344ce8b9d4314f92d285","created_at":"2026-08-20T08:23:26.626Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3670f6bafae0a6e27150d51ca4150563","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.645Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-29f1344ce8b9d4314f92d285: start","job_status":"start","queue_duration_s":0.896127,"scheduling_latency_s":0.896151}2403gitlab # [ 435.873327] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/76fc2c714d939d1c6b4fb858e107c3c988ec740c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1832404gitlab # [ 435.875716] gitaly[910]: time="2026-08-20T08:23:27.600Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F496FMQSRMNXV5M1GE933M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T08:23:37.300" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T08:23:27.590" grpc.time_ms=9.916 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2405gitlab # [ 435.889178] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"29f1344ce8b9d4314f92d285","created_at":"2026-08-20T08:23:26.626Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3670f6bafae0a6e27150d51ca4150563","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.645Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-29f1344ce8b9d4314f92d285: done: 0.045551 sec","job_status":"done","queue_duration_s":0.896127,"scheduling_latency_s":0.896151,"redis_calls":11,"redis_duration_s":0.002864,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048912,"exclusive_lock_hold_duration_s":0.01220012,"duration_s":0.045551,"completed_at":"2026-08-20T08:23:27.586Z","load_balancing_strategy":"primary","db_duration_s":0.00496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 435.930831] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"752d8cac4c6fb570ede1b28f","created_at":"2026-08-20T08:23:26.661Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f22b07438f5b114594a5452f028247e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.685Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-752d8cac4c6fb570ede1b28f: start","job_status":"start","queue_duration_s":0.904005,"scheduling_latency_s":0.90405}2407gitlab # [ 435.945251] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"752d8cac4c6fb570ede1b28f","created_at":"2026-08-20T08:23:26.661Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f22b07438f5b114594a5452f028247e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.685Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-752d8cac4c6fb570ede1b28f: done: 0.049787 sec","job_status":"done","queue_duration_s":0.904005,"scheduling_latency_s":0.90405,"redis_calls":9,"redis_duration_s":0.002563,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000599,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.049787,"completed_at":"2026-08-20T08:23:27.639Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 435.988134] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ee876aabfb8d43f154f8e93d","created_at":"2026-08-20T08:23:26.705Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbe489a7e4718b1f8f6f1d8f4cc8eab7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.728Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ee876aabfb8d43f154f8e93d: start","job_status":"start","queue_duration_s":0.914863,"scheduling_latency_s":0.914903}2409gitlab # [ 436.002443] nix-daemon[3744]: accepted connection from pid 4496, user nixbot2410gitlab # [ 436.051377] gitaly[910]: time="2026-08-20T08:23:27.939Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0F496VFT2G1C2NE561831TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:27.923" grpc.time_ms=16.383 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2411gitlab # [ 436.070478] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 842412gitlab # [ 436.089018] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.976Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"ee876aabfb8d43f154f8e93d","created_at":"2026-08-20T08:23:26.705Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbe489a7e4718b1f8f6f1d8f4cc8eab7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.728Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-ee876aabfb8d43f154f8e93d: done: 0.333858 sec","job_status":"done","queue_duration_s":0.914863,"scheduling_latency_s":0.914903,"redis_calls":11,"redis_duration_s":0.003361,"redis_read_bytes":9,"redis_write_bytes":1292,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000512,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001362,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.047,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.267246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00077322,"exclusive_lock_hold_duration_s":0.30057934,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.333858,"completed_at":"2026-08-20T08:23:27.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2413gitlab # [ 436.145158] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6501cc598cf66026a140e236","created_at":"2026-08-20T08:23:26.749Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92cca4c8dd628421b5c6d9819cc2fdc1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.767Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6501cc598cf66026a140e236: start","job_status":"start","queue_duration_s":1.21144,"scheduling_latency_s":1.211466}2414gitlab # [ 436.159796] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:27.994Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2415gitlab # [ 436.163536] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6501cc598cf66026a140e236","created_at":"2026-08-20T08:23:26.749Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"92cca4c8dd628421b5c6d9819cc2fdc1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.767Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6501cc598cf66026a140e236: done: 0.024466 sec","job_status":"done","queue_duration_s":1.21144,"scheduling_latency_s":1.211466,"redis_calls":9,"redis_duration_s":0.002486,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000641,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024466,"completed_at":"2026-08-20T08:23:28.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 436.208138] gitaly[910]: time="2026-08-20T08:23:28.049Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0F496Y58Q5S72FGGF40M6P9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:28.037" pid=910 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2417gitlab # [ 436.218600] gitlab-workhorse[825]: time="2026-08-20T08:23:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672418gitlab # [ 436.220507] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:28 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1092419gitlab # [ 436.222444] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9327e14aa86f99a0726333e8","created_at":"2026-08-20T08:23:26.775Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"109b79855a279e59fff1e7c144481298","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.795Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9327e14aa86f99a0726333e8: start","job_status":"start","queue_duration_s":1.209917,"scheduling_latency_s":1.209941}2420gitlab # [ 436.236328] gitaly[910]: time="2026-08-20T08:23:28.049Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F496Y58Q5S72FGGF40M6P9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:28.037" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2421gitlab # [ 436.249765] gitaly[910]: time="2026-08-20T08:23:28.050Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F496Y58Q5S72FGGF40M6P9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T08:23:28.037" grpc.time_ms=11.881 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc2422gitlab # [ 436.281116] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9327e14aa86f99a0726333e8","created_at":"2026-08-20T08:23:26.775Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"109b79855a279e59fff1e7c144481298","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.795Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9327e14aa86f99a0726333e8: done: 0.164038 sec","job_status":"done","queue_duration_s":1.209917,"scheduling_latency_s":1.209941,"redis_calls":70,"redis_duration_s":0.023789,"redis_read_bytes":118,"redis_write_bytes":42530,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003424,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000544,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.019075,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000746,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.164038,"completed_at":"2026-08-20T08:23:28.169Z","load_balancing_strategy":"primary","db_duration_s":0.004475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2423gitlab # [ 436.325292] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5246e8f64fa4aba28ad7ae44","created_at":"2026-08-20T08:23:26.825Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d9dc574daebd5fdb6a50e8c510d604d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.839Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5246e8f64fa4aba28ad7ae44: start","job_status":"start","queue_duration_s":1.334327,"scheduling_latency_s":1.334351}2424gitlab # [ 436.339713] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.200Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"5246e8f64fa4aba28ad7ae44","created_at":"2026-08-20T08:23:26.825Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d9dc574daebd5fdb6a50e8c510d604d","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.839Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-5246e8f64fa4aba28ad7ae44: done: 0.027582 sec","job_status":"done","queue_duration_s":1.334327,"scheduling_latency_s":1.334351,"redis_calls":9,"redis_duration_s":0.001419,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000824,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027582,"completed_at":"2026-08-20T08:23:28.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2425gitlab # [ 436.383971] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ff6542e81a2bbef14263b025","created_at":"2026-08-20T08:23:26.894Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f68aeeb94d6a3e32a0b0f582d4783cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:23:26.928Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ff6542e81a2bbef14263b025: start","job_status":"start","queue_duration_s":1.273934,"scheduling_latency_s":1.273953}2426gitlab # [ 436.397984] nix-daemon[3744]: accepted connection from pid 4521, user nixbot2427gitlab # [ 436.398931] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.213Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2428gitlab # [ 436.402797] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ff6542e81a2bbef14263b025","created_at":"2026-08-20T08:23:26.894Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f68aeeb94d6a3e32a0b0f582d4783cd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T08:23:26.928Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ff6542e81a2bbef14263b025: done: 0.018862 sec","job_status":"done","queue_duration_s":1.273934,"scheduling_latency_s":1.273953,"redis_calls":9,"redis_duration_s":0.001306,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018862,"completed_at":"2026-08-20T08:23:28.220Z","load_balancing_strategy":"primary","db_duration_s":0.000595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429gitlab # [ 436.445469] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"81f29992e31ba8e0167ecb43","created_at":"2026-08-20T08:23:26.948Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9406662d17ea1a5226276381be75da09","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.978Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-81f29992e31ba8e0167ecb43: start","job_status":"start","queue_duration_s":1.244501,"scheduling_latency_s":1.24452}2430gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses2431gitlab # [ 436.683040] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"81f29992e31ba8e0167ecb43","created_at":"2026-08-20T08:23:26.948Z","trace_propagation_headers":{"sentry-trace":"99b3c96ca33445ee8d4985dfe9d8fe19-e30e64be6f7e4619","baggage":"sentry-trace_id=99b3c96ca33445ee8d4985dfe9d8fe19,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9406662d17ea1a5226276381be75da09","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:26.978Z","job_size_bytes":2,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-81f29992e31ba8e0167ecb43: done: 0.34766 sec","job_status":"done","queue_duration_s":1.244501,"scheduling_latency_s":1.24452,"redis_calls":564,"redis_duration_s":0.06695,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001456,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.065109,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.308032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.34766,"completed_at":"2026-08-20T08:23:28.570Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2432gitlab # [ 436.734812] sidekiq-cluster[3479]: {"severity":"INFO","time":"2026-08-20T08:23:28.574Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9fff91805e5467b90b642643","created_at":"2026-08-20T08:23:27.208Z","trace_propagation_headers":{"sentry-trace":"6ebf99ccda6340e4adda45ad7404af09-343c9211ac4b4187","baggage":"sentry-trace_id=6ebf99ccda6340e4adda45ad7404af09,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0F495YJXBYNKDGASAPMYEA6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T08:23:27.217Z","job_size_bytes":3,"pid":3479,"sidekiq_tid":"m8sf","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9fff91805e5467b90b642643: start","job_status":"start","queue_duration_s":1.357003,"scheduling_latency_s":1.357055}2433gitlab # [ 436.751390] gitaly[910]: time="2026-08-20T08:23:28.612Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0F497GV1F4ZTAQ2VQWE03PF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T08:23:58.310" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T08:23:28.611" grpc.time_ms=1.225 pid=910 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2434gitlab # [ 436.794193] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/20:08:23:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1412435gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/76fc2c714d939d1c6b4fb858e107c3c988ec740c/statuses, in 0.23 seconds)2436(finished: subtest: eval and build post commit statuses, in 6.31 seconds)2437(finished: run the VM test script, in 506.75 seconds)2438test script finished in 506.79s2439cleanup2440kill QemuMachine (pid 46)2441gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2442(finished: cleanup, in 1.39 seconds)2443additionally exposed symbols:2444 gitlab,2445 vlan1,2446 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2447[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T08:21:46.928Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[]2458[]2459[]2460[]2461[]2462[]2463[]2464[]2465[]2466[]2467[]2468[]2469[]2470[]2471[]2472[]2473[]2474[]2475[]2476[]2477[]2478[]2479[]2480[]2481[]2482[]2483[]2484[]2485[]2486[]2487[]2488[]2489[]2490[]2491[]2492[]2493[]2494[]2495[]2496[]2497[]2498[]2499[]2500[]2501[]2502[]2503[]2504[]2505[]2506[]2507[]2508[]2509[]2510[]2511[]2512[]2513[]2514[]2515[]2516[]2517[]2518[]2519[]2520[]2521[]2522[]2523[]2524[]2525[]2526[]2527[]2528[]2529[]2530[]2531[]2532[]2533[]2534[]2535[]2536[]2537[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T08:23:21.491150Z', 'started_at': '2026-08-20T08:23:21.963172Z', 'finished_at': None}]2538[{'id': 5, 'sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:23:21.928Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2539[{'id': 5, 'sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:23:21.928Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2540[{'id': 5, 'sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:23:21.928Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2541[{'id': 5, 'sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T08:23:21.928Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2542[{'id': 5, 'sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T08:23:21.928Z', 'started_at': None, 'finished_at': '2026-08-20T08:23:27.186Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2543[{'id': 5, 'sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T08:23:21.928Z', 'started_at': None, 'finished_at': '2026-08-20T08:23:27.186Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '76fc2c714d939d1c6b4fb858e107c3c988ec740c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-20T08:23:27.438Z', 'started_at': None, 'finished_at': '2026-08-20T08:23:27.628Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]