vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #235
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.MKBNJHSXUm', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 71.70 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 7f42140e-7b3b-4fe6-a712-c4bbb5b1160f19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/h5i6b2fc6dfhm0a48i0hgwicpckknpxg-nixos-system-gitlab-test/init regInfo=/nix/store/0d2s7ms61qd414nv70s4baj0dxksyfd4-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/0d2s7ms61qd414nv70s4baj0dxksyfd4-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000029] arm-pv: using stolen time PV108gitlab # [ 0.000382] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000571] Console: colour dummy device 80x25110gitlab # [ 0.000578] printk: legacy console [tty0] enabled111gitlab # [ 0.000752] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000758] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000834] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000964] landlock: Up and running.115gitlab # [ 0.000967] Yama: becoming mindful.116gitlab # [ 0.001373] LSM support for eBPF active117gitlab # [ 0.001564] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001662] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002693] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003356] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003360] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003505] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004510] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004603] EFI services will not be available.125gitlab # [ 0.004754] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005389] Detected PIPT I-cache on CPU1127gitlab # [ 0.005485] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005606] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005730] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006821] Detected PIPT I-cache on CPU2131gitlab # [ 0.006928] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007050] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007175] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008240] Detected PIPT I-cache on CPU3135gitlab # [ 0.008366] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008492] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008623] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009164] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009193] SMP: Total of 4 processors activated.140gitlab # [ 0.009195] CPU: All CPU(s) started at EL1141gitlab # [ 0.009204] CPU features: detected: Branch Target Identification142gitlab # [ 0.009208] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009211] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009214] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009218] CPU features: detected: Common not Private translations146gitlab # [ 0.009220] CPU features: detected: CRC32 instructions147gitlab # [ 0.009223] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009226] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009229] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009232] CPU features: detected: E0PD151gitlab # [ 0.009234] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009237] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009240] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009243] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009246] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009250] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009252] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009255] CPU features: detected: Privileged Access Never159gitlab # [ 0.009257] CPU features: detected: PMUv3160gitlab # [ 0.009260] CPU features: detected: RAS Extension Support161gitlab # [ 0.009263] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009265] CPU features: detected: Random Number Generator163gitlab # [ 0.009267] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009270] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009272] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009276] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009423] alternatives: applying system-wide alternatives168gitlab # [ 0.012143] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012373] Memory: 5963792K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013793] devtmpfs: initialized171gitlab # [ 0.017656] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017721] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.017889] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.017894] 0 pages in range for non-PLT usage175gitlab # [ 0.017895] 508288 pages in range for PLT usage176gitlab # [ 0.018009] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.018806] DMI not present or invalid.178gitlab # [ 0.021981] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024433] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024701] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026418] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026440] audit: initializing netlink subsys (disabled)183gitlab # [ 0.026759] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027176] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027179] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027183] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027186] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027188] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027280] cpuidle: using governor ladder190gitlab # [ 0.027302] cpuidle: using governor menu191gitlab # [ 0.027513] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.027727] ASID allocator initialised with 65536 entries193gitlab # [ 0.028834] Serial: AMBA PL011 UART driver194gitlab # [ 0.033949] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034264] printk: console [ttyAMA0] enabled196gitlab # [ 0.050159] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.050166] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.050169] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.050171] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.050174] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.050177] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.050180] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.050182] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.061756] fbcon: Taking over console205gitlab # [ 0.061786] ACPI: Interpreter disabled.206gitlab # [ 0.064329] iommu: Default domain type: Translated207gitlab # [ 0.064342] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.090247] SCSI subsystem initialized209gitlab # [ 0.090845] usbcore: registered new interface driver usbfs210gitlab # [ 0.090883] usbcore: registered new interface driver hub211gitlab # [ 0.090925] usbcore: registered new device driver usb212gitlab # [ 0.091407] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.091414] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.091440] PTP clock support registered215gitlab # [ 0.091519] EDAC MC: Ver: 3.0.0216gitlab # [ 0.092019] scmi_core: SCMI protocol bus registered217gitlab # [ 0.092919] FPGA manager framework218gitlab # [ 0.093946] vgaarb: loaded219gitlab # [ 0.095387] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.096377] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.096421] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.101802] netfs: FS-Cache loaded223gitlab # [ 0.102011] pnp: PnP ACPI: disabled224gitlab # [ 0.110042] NET: Registered PF_INET protocol family225gitlab # [ 0.111590] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.150271] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.150325] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.150377] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.150698] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.151413] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.151513] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.151572] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.151712] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.151962] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.152021] NET: Registered PF_XDP protocol family236gitlab # [ 0.152038] PCI: CLS 0 bytes, default 64237gitlab # [ 0.152328] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.159865] kvm [1]: HYP mode not available239gitlab # [ 0.212109] Initialise system trusted keyrings240gitlab # [ 0.212320] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.212912] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.213047] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.225623] Key type asymmetric registered244gitlab # [ 0.225628] Asymmetric key parser 'x509' registered245gitlab # [ 0.225677] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.225869] io scheduler mq-deadline registered247gitlab # [ 0.225874] io scheduler kyber registered248gitlab # [ 0.236451] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.239880] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.240276] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.240292] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.240302] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.240309] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.240346] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.240368] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.240441] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.240450] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.240454] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.240457] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.240461] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.240564] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.241195] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.241604] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.241621] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.241660] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.241676] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.242568] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.242931] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.242946] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.242979] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.243737] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.244118] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.244133] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.244170] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.244920] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.245285] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.245300] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.245332] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.246100] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.246451] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.246466] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.246499] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.247211] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.247512] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.247527] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.247559] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.248182] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.248528] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.248543] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.248575] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.248591] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.249342] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.249668] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.249707] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.250493] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.250929] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.250974] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.251644] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.251890] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.252235] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.252722] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.252738] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.252777] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.253641] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.254026] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.254041] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.254074] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.255017] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.255025] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.255029] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.255084] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.255180] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.255273] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.255367] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.255451] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.255512] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.255572] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.255633] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.255694] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.255781] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.255834] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.255859] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.255892] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.255914] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.255936] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.255971] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.255993] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.256027] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.256061] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.256095] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.256130] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.256164] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.256198] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.256219] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.256241] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.256263] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.256284] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.256306] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.256328] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.256350] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.256372] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.256399] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.256405] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.256409] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.258975] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.272743] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.275082] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.277460] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.279963] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.282418] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.287966] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.290297] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.292619] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.295104] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.297207] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.303360] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.309823] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.311837] msm_serial: driver initialized359gitlab # [ 0.312032] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.312090] STM32 USART driver initialized361gitlab # [ 0.336930] loop: module loaded362gitlab # [ 0.337174] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.339274] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.341312] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.343230] virtio_blk virtio5: [vdb] 12227528 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.345495] megasas: 07.734.00.00-rc1367gitlab # [ 0.346279] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.349429] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.349447] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.351298] Using buffer write method371gitlab # [ 0.351342] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.353388] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.353405] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.355143] Using buffer write method375gitlab # [ 0.355159] Concatenating MTD devices:376gitlab # [ 0.355162] (0): "0.flash"377gitlab # [ 0.355164] (1): "0.flash"378gitlab # [ 0.355167] into device "0.flash"379gitlab # [ 0.650592] Freeing initrd memory: 27184K380gitlab # [ 0.667985] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.676257] thunder_xcv, ver 1.0382gitlab # [ 0.676350] thunder_bgx, ver 1.0383gitlab # [ 0.676417] nicpf, ver 1.0384gitlab # [ 0.678084] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.678095] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.678160] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.678173] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.678240] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.678249] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.678334] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.678344] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.678745] sky2: driver version 1.30393gitlab # [ 0.683390] usbcore: registered new interface driver usb-storage394gitlab # [ 0.683812] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.683830] ehci-pci 0000:00:0a.0: EHCI Host Controller396gitlab # [ 0.683941] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1397gitlab # [ 0.683965] usbserial: USB Serial support registered for generic398gitlab # [ 0.684704] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.685752] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.688351] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.688408] rtc-pl031 9010000.pl031: setting system clock to 2026-08-16T17:26:17 UTC (1786901177)402gitlab # [ 0.689294] i2c_dev: i2c /dev entries driver403gitlab # [ 0.695507] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.696365] hub 1-0:1.0: USB hub found405gitlab # [ 0.696412] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.697684] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.697699] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.698493] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.699673] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.704402] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.705301] usbcore: registered new interface driver usbhid412gitlab # [ 0.705312] usbhid: USB HID core driver413gitlab # [ 0.740723] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.744904] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.745278] NET: Registered PF_INET6 protocol family416gitlab # [ 0.746956] Segment Routing with IPv6417gitlab # [ 0.746990] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.747083] NET: Registered PF_PACKET protocol family419gitlab # [ 0.747369] 9pnet: Installing 9P2000 support420gitlab # [ 0.751583] Key type dns_resolver registered421gitlab # [ 0.768622] registered taskstats version 1422gitlab # [ 0.769142] Loading compiled-in X.509 certificates423gitlab # [ 0.791097] Demotion targets for Node 0: null424gitlab # [ 0.791311] Key type .fscrypt registered425gitlab # [ 0.791318] Key type fscrypt-provisioning registered426gitlab # [ 0.791511] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.791535] ima: Allocated hash algorithm: sha1428gitlab # [ 0.791563] ima: No architecture policies found429gitlab # [ 0.792765] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.817416] clk: Disabling unused clocks431gitlab # [ 0.817445] PM: genpd: Disabling unused power domains432gitlab # [ 0.822134] Freeing unused kernel memory: 4736K433gitlab # [ 0.822363] Run /init as init process434gitlab # [ 0.855105] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.943479] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.100286] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.188265] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.189751] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.189796] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.189858] systemd[1]: Detected architecture arm64.441gitlab # [ 1.189873] systemd[1]: Running in initrd.442gitlab # [ 1.190702] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.190953] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.307475] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.461538] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2446gitlab # [ 1.462027] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0447gitlab # [ 1.618026] systemd[1]: bpf-restrict-fs: LSM BPF program attached448gitlab # [ 1.716110] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.739696] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.740086] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.740141] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.740162] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.740199] systemd[1]: Reached target Path Units.454gitlab # [ 1.740228] systemd[1]: Reached target Slice Units.455gitlab # [ 1.740259] systemd[1]: Reached target Swaps.456gitlab # [ 1.740287] systemd[1]: Reached target Timer Units.457gitlab # [ 1.740535] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.740790] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.741029] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.741253] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.741386] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.741417] systemd[1]: Reached target Socket Units.463gitlab # [ 1.743900] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.746469] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.746568] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.749184] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.775970] systemd[1]: Starting Journal Service...468gitlab # [ 1.780067] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.780288] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.787753] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.792164] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.794616] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.795632] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.797081] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.800891] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.829815] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.477gitlab # [ 1.832313] systemd[1]: Starting Create Static Device Nodes in /dev...478gitlab # [ 1.833836] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.479gitlab # [ 1.834374] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev480gitlab # [ 1.839366] systemd-journald[95]: Collecting audit messages is disabled.481gitlab # [ 1.843519] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0482gitlab # [ 1.843727] [drm] features: -virgl +edid -resource_blob -host_visible483gitlab # [ 1.843743] [drm] features: -context_init484gitlab # [ 1.847418] [drm] number of scanouts: 1485gitlab # [ 1.847449] [drm] number of cap sets: 0486gitlab # [ 1.848380] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.848392] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.849777] systemd[1]: Finished Create Static Device Nodes in /dev.489gitlab # [ 1.849952] systemd[1]: Reached target Preparation for Local File Systems.490gitlab # [ 1.849977] systemd[1]: Reached target Local File Systems.491gitlab # [ 1.853291] systemd[1]: Starting Rule-based Manager for Device Events and Files...492gitlab # [ 1.863438] Console: switching to colour frame buffer device 160x50493gitlab # [ 1.864691] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device494gitlab # [ 1.877628] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.883587] systemd[1]: Starting Apply Kernel Variables...496gitlab # [ 1.904124] systemd[1]: Finished Apply Kernel Variables.497gitlab # [ 1.924911] systemd[1]: Started Journal Service.498gitlab # [ 1.921556] systemd-modules-load[96]: Using 4 probe threads499gitlab # [ 1.924788] systemd-modules-load[96]: Module 'virtio_balloon' is built in500gitlab # [ 1.926031] systemd-modules-load[96]: Module 'virtio_console' is built in501gitlab # [ 1.927262] systemd-modules-load[96]: Module 'virtio_rng' is built in502gitlab # [ 1.928471] systemd-modules-load[96]: Inserted module 'dm_mod'503gitlab # [ 1.929546] systemd-modules-load[96]: Inserted module 'virtio_gpu'504gitlab # [ 1.930968] systemd-udevd[105]: Using default interface naming scheme 'v261'.505gitlab # [ 1.932776] systemd[1]: Starting Create System Files and Directories...506gitlab # [ 1.950073] systemd[1]: Started Rule-based Manager for Device Events and Files.507gitlab # [ 1.961975] systemd[1]: Finished Create System Files and Directories.508gitlab # [ 1.970611] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 2.019100] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 2.022841] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.429578] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.432254] systemd[1]: Reached target System Initialization.513gitlab # [ 2.434708] systemd[1]: Reached target Basic System.514gitlab # [ 2.616876] (udev-worker)[134]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.633641] (udev-worker)[126]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.639282] (udev-worker)[126]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.674723] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.676524] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.678088] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.687035] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.721545] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.725502] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.788401] systemd[1]: Mounting /sysroot...524gitlab # [ 2.821281] EXT4-fs (vda): mounted filesystem 7f42140e-7b3b-4fe6-a712-c4bbb5b1160f r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.821579] systemd[1]: Mounted /sysroot.526gitlab # [ 2.822750] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.826077] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.828979] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.848595] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.850478] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.860341] systemd[1]: Mounting /sysroot/tmp/xchg...[ 2.863936] erofs (device vdb): mounted with root inode @ nid 128.532gitlab # 533gitlab # [ 2.867947] systemd[1]: Starting Mountpoints Configured in the Real Root...534gitlab # [ 2.872107] systemd[1]: Mounted /sysroot/nix/.ro-store.535gitlab # [ 2.873139] systemd[1]: Mounted /sysroot/nix/.rw-store.536gitlab # [ 2.880290] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 2.881898] systemd[1]: Mounted /sysroot/tmp/shared.538gitlab # [ 2.885093] systemd[1]: Mounted /sysroot/run.539gitlab # [ 2.890163] systemd[1]: Mounted /sysroot/tmp/xchg.540gitlab # [ 2.892668] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.541gitlab # [ 2.897602] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.542gitlab # [ 2.898646] systemd[1]: Finished rw-sysroot-nix-store.service.543gitlab # [ 2.899466] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...544gitlab # [ 2.901344] systemd[1]: Reloading...545gitlab # [ 2.994686] systemd[1]: Reloading finished in 95 ms.546gitlab # [ 3.051828] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...547gitlab # [ 3.053419] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 3.055047] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 3.058528] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 3.072151] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 3.073434] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 3.075756] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 3.077322] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 3.199798] (udev-worker)[145]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 3.203408] (udev-worker)[145]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 3.210006] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.211169] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.212367] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.213231] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.232841] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 3.233933] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 3.234695] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.257137] systemd-vconsole-setup[196]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.259377] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.793312] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.867551] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.869953] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.872408] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.874888] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.916388] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.919941] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.936148] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.938456] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.941022] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.994440] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.997093] systemd[1]: Stopped target Basic System.577gitlab # [ 3.999258] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 4.001742] systemd[1]: Stopped target Path Units.579gitlab # [ 4.003871] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 4.007292] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 4.010739] systemd[1]: Stopped target Slice Units.582gitlab # [ 4.012964] systemd[1]: Stopped target Socket Units.583gitlab # [ 4.015104] systemd[1]: Stopped target System Initialization.584gitlab # [ 4.018759] systemd[1]: Stopped target Swaps.585gitlab # [ 4.022358] systemd[1]: Stopped target Timer Units.586gitlab # [ 4.026133] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 4.028757] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 4.031435] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 4.035278] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 4.037904] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 4.041136] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 4.043762] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 4.046824] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 4.049013] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 4.051967] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 4.053895] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 4.056732] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 4.059371] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 4.061854] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 4.063874] systemd[1]: Stopped target Local File Systems.601gitlab # [ 4.065668] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 4.067615] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 4.069729] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 4.071223] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 4.073275] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 4.075117] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 4.076535] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 4.078129] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 4.079685] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 4.081477] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 4.082798] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.612gitlab # [ 4.084462] systemd[1]: Finished Load Kernel Module 9pnet_virtio.613gitlab # [ 4.085779] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 4.087215] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 4.089011] systemd[1]: systemd-udevd.service: Consumed 2.117s CPU time over 2.211s wall clock time, 31.8M memory peak.616gitlab # [ 4.091149] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 4.092716] systemd[1]: Closed udev Control Socket.618gitlab # [ 4.093781] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 4.094941] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 4.096659] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 4.098000] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 4.099725] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 4.101374] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 4.102906] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 4.189276] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 4.194057] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 4.196552] systemd[1]: Reached target Switch Root.628gitlab # [ 4.198694] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.372876] initrd-nixos-activation-start[223]: booting system configuration /nix/store/h5i6b2fc6dfhm0a48i0hgwicpckknpxg-nixos-system-gitlab-test630gitlab # [ 4.433528] initrd-nixos-activation-start[223]: running activation script...631gitlab # [ 4.744004] initrd-nixos-activation-start[246]: setting up /etc...632gitlab # [ 4.916228] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.919564] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.922056] systemd[1]: Starting Switch Root...635gitlab # [ 4.966883] systemd[1]: Switching root.636gitlab # [ 5.071269] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.672541] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.672680] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.672757] systemd[1]: Detected architecture arm64.640gitlab # [ 5.672933] systemd[1]: Detected first boot.641gitlab # [ 5.674279] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 5.914316] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.041852] systemd[1]: Applying preset policy.644gitlab # [ 6.224339] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.437543] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.438000] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.440544] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.445011] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.452053] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.455081] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.455747] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.457176] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.458318] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.459437] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.460639] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.461727] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.462786] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.463908] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.464980] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.466090] systemd[1]: Reached target Path Units.661gitlab # [ 6.467156] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.468268] systemd[1]: Reached target Slice Units.663gitlab # [ 6.469310] systemd[1]: Reached target Swaps.664gitlab # [ 6.473278] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.477568] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.480710] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.484419] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.485698] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.494812] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.496893] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.500350] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.501665] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.502581] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.503495] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.508537] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.509613] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.510686] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.517880] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.525002] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.537641] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.547299] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.563997] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.570817] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.572100] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.584097] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.584991] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.585849] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.605104] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.606169] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.617700] systemd[1]: Starting Journal Service...691gitlab # [ 6.622895] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.635680] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.640896] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 6.643607] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 6.655636] systemd[1]: Starting Coldplug All udev Devices...696gitlab # [ 6.664591] systemd-journald[317]: Collecting audit messages is enabled.697gitlab # [ 6.666816] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 6.667915] systemd[1]: Mounted Huge Pages File System.699gitlab # [ 6.668828] systemd[1]: Mounted POSIX Message Queue File System.700gitlab # [ 6.669676] systemd[1]: Mounted Kernel Debug File System.701gitlab # [ 6.670534] systemd[1]: Mounted Kernel Trace File System.702gitlab # [ 6.671752] systemd[1]: Finished Create List of Static Device Nodes.703gitlab # [ 6.672835] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.704gitlab # [ 6.673820] systemd[1]: Finished Load Kernel Module 9pnet_virtio.705gitlab # [ 6.674750] systemd[1]: Mounted Kernel Configuration File System.706gitlab # [ 6.680333] fuse: init (API version 7.45)707gitlab # [ 6.691757] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...708gitlab # [ 6.696579] systemd[1]: modprobe@fuse.service: Deactivated successfully.709gitlab # [ 6.697709] systemd[1]: Finished Load Kernel Module fuse.710gitlab # [ 6.699036] systemd[1]: Finished Load Kernel Modules.711gitlab # [ 6.701973] systemd[1]: Queued start job for default target Multi-User System.712gitlab # [ 6.705994] systemd[1]: Mounting FUSE Control File System...713gitlab # [ 6.705900] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 6.708937] EXT4-fs (vda): re-mounted 7f42140e-7b3b-4fe6-a712-c4bbb5b1160f.714gitlab # 715gitlab # [ 6.709947] systemd[1]: systemd-journald.service: Deactivated successfully.716gitlab # [ 6.715979] systemd[1]: Starting Firewall...717gitlab # [ 6.712858] systemd-modules-load[318]: Using 3 probe threads718gitlab # [ 6.715736] systemd-modules-load[318]: Module 'atkbd' is built in719gitlab # [ 6.717453] systemd-modules-load[318]: Module 'loop' is built in720gitlab # [ 6.718889] systemd-modules-load[318]: Inserted module 'tls'721gitlab # [ 6.733270] systemd-oomd[320]: No swap; memory pressure usage will be degraded722gitlab # [ 6.743574] systemd[1]: Starting Apply Kernel Variables...723gitlab # [ 6.746329] systemd[1]: Started Journal Service.724gitlab # [ 6.749792] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.725gitlab # [ 6.755396] systemd[1]: Finished Remount Root and Kernel File Systems.726gitlab # [ 6.757981] systemd[1]: Mounted FUSE Control File System.727gitlab # [ 6.760039] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.728gitlab # [ 6.770347] systemd[1]: Listening on Disk Image Download Service Socket.729gitlab # [ 6.774202] systemd[1]: Starting Flush Journal to Persistent Storage...730gitlab # [ 6.776033] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore731gitlab # [ 6.780251] systemd[1]: Starting Load/Save OS Random Seed...732gitlab # [ 6.783752] systemd[1]: Starting Create Static Device Nodes in /dev...733gitlab # [ 6.784959] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os734gitlab # [ 6.798374] systemd[1]: Finished Apply Kernel Variables.735gitlab # [ 6.810179] systemd-journald[317]: Received client request to flush runtime journal.736gitlab # [ 6.832909] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 6.835350] systemd[1]: Reached target First Boot Complete.738gitlab # [ 6.836661] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 6.837650] systemd[1]: Reached target Preparation for Local File Systems.740gitlab # [ 6.838668] systemd[1]: Starting Rule-based Manager for Device Events and Files...741gitlab # [ 6.839764] systemd[1]: Finished Flush Journal to Persistent Storage.742gitlab # [ 6.902018] systemd-udevd[362]: Using default interface naming scheme 'v261'.743gitlab # [ 6.940555] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 7.262733] systemd[1]: Finished Firewall.745gitlab # [ 7.316104] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 7.387037] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 7.465339] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.748gitlab # [ 7.470658] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.749gitlab # [ 7.472711] systemd[1]: Mounting /run/wrappers...750gitlab # [ 7.490373] (udev-worker)[475]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.751gitlab # [ 7.492721] (udev-worker)[475]: Network interface NamePolicy= disabled on kernel command line.752gitlab # [ 7.494676] (udev-worker)[399]: Network interface NamePolicy= disabled on kernel command line.753gitlab # [ 7.509642] systemd[1]: Condition check resulted in Virtio network device being skipped.754gitlab # [ 7.511556] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore755gitlab # [ 7.513545] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67756gitlab # [ 7.515753] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore757gitlab # [ 7.518573] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os758gitlab # [ 7.519874] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os759gitlab # [ 7.521198] systemd[1]: Mounted /run/wrappers.760gitlab # [ 7.521868] systemd[1]: Reached target Local File Systems.761gitlab # [ 7.522654] systemd[1]: Listening on Boot Loader Control Service Socket.762gitlab # [ 7.523586] systemd[1]: Starting register-nix-paths.service...763gitlab # [ 7.526258] systemd[1]: Starting Create SUID/SGID Wrappers...764gitlab # [ 7.527198] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.765gitlab # [ 7.529639] systemd[1]: Starting Save Transient machine-id to Disk...766gitlab # [ 7.551816] systemd[1]: Starting Create System Files and Directories...767gitlab # [ 7.570509] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.768gitlab # [ 7.573247] systemd[1]: Finished Save Transient machine-id to Disk.769gitlab # [ 7.598687] systemd[1]: Finished Create System Files and Directories.770gitlab # [ 7.604534] systemd[1]: Starting Rebuild Journal Catalog...771gitlab # [ 7.612464] systemd[1]: Starting Record System Boot/Shutdown in UTMP...772gitlab # [ 7.619267] mousedev: PS/2 mouse device common for all mice773gitlab # [ 7.637312] systemd[1]: Finished Record System Boot/Shutdown in UTMP.774gitlab # [ 7.650094] systemd[1]: Finished Rebuild Journal Catalog.775gitlab # [ 7.654030] systemd[1]: Starting Update is Completed...776gitlab # [ 7.684356] systemd[1]: Finished Update is Completed.777gitlab # [ 7.708653] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.778gitlab # [ 7.710224] systemd[1]: Finished Create SUID/SGID Wrappers.779gitlab # [ 7.711452] systemd[1]: suid-sgid-wrappers.service: Consumed 126ms CPU time over 182ms wall clock time, 6.1M memory peak, 1.9M read from disk.780gitlab # [ 7.996567] systemd[1]: Finished register-nix-paths.service.781gitlab # [ 7.998761] systemd[1]: Reached target System Initialization.782gitlab # [ 8.001035] systemd[1]: Started Discard unused filesystem blocks once a week.783gitlab # [ 8.003511] systemd[1]: Started logrotate.timer.784gitlab # [ 8.004528] systemd[1]: Started Daily Cleanup of Temporary Directories.785gitlab # [ 8.005545] systemd[1]: Reached target Timer Units.786gitlab # [ 8.006326] systemd[1]: Listening on D-Bus System Message Bus Socket.787gitlab # [ 8.007304] systemd[1]: Listening on Nix Daemon Socket.788gitlab # [ 8.015743] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3789gitlab # [ 8.024107] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 8.025098] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 8.030687] systemd[1]: Starting D-Bus System Message Bus...792gitlab # [ 8.031676] systemd[1]: Listening on nixbot CI service socket.793gitlab # [ 8.032652] systemd[1]: Reached target Socket Units.794gitlab # [ 8.079415] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 8.081319] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 8.082913] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 8.089088] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 8.100956] dbus-broker-launch[563]: Ready799gitlab # [ 8.102839] systemd[1]: Reached target Basic System.800gitlab # [ 8.107158] systemd[1]: Started backdoor.service.801gitlab # [ 8.114309] systemd[1]: Starting gitlab-config.service...802gitlab # [ 8.128145] systemd[1]: Starting Import lastlog data into lastlog2 database...803gitlab # [ 8.129502] systemd[1]: Starting Logrotate configuration check...804gitlab # [ 8.133170] systemd[1]: Starting Name Service Cache Daemon (nsncd)...805gitlab # [ 8.141232] systemd[1]: Starting Post-Boot Actions...806gitlab # connecting to host...807gitlab # [ 8.148528] logrotate[571]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.808gitlab # [ 8.151799] logrotate[571]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf809gitlab # [ 8.153783] logrotate[571]: note: 'monthly' overrides previously specified 'weekly'810gitlab # [ 8.155702] logrotate[571]: Reading state from file: /var/lib/logrotate.status811gitlab # [ 8.160271] logrotate[571]: state file /var/lib/logrotate.status does not exist812gitlab # [ 8.161575] logrotate[571]: Allocating hash table for state file, size 64 entries813gitlab # [ 8.162660] logrotate[571]: Handling 4 logs814gitlab # [ 8.163275] logrotate[571]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed815gitlab: Guest shell says: b'Spawning backdoor root shell...\n'816gitlab # [ 8.169637] logrotate[571]: considering log /var/log/btmp817gitlab # [ 8.170537] logrotate[571]: Creating new state818gitlab # [ 8.171157] logrotate[571]: Now: 2026-08-16 17:26819gitlab: connected to guest root shell820gitlab # [ 8.171783] logrotate[571]: Last rotated at 2026-08-16 17:00821gitlab: (connecting took 8.62 seconds)822gitlab # [ 8.174434] logrotate[571]: log does not need rotating (log has already been rotated)823gitlab: (finished: waiting for the VM to finish booting, in 8.62 seconds)824gitlab # [ 8.175554] logrotate[571]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed825gitlab # [ 8.178100] logrotate[571]: considering log /var/log/wtmp826gitlab # [ 8.178778] logrotate[571]: Creating new state827gitlab # [ 8.179386] logrotate[571]: Now: 2026-08-16 17:26828gitlab # [ 8.180603] logrotate[571]: Last rotated at 2026-08-16 17:00829gitlab # [ 8.181338] logrotate[571]: log does not need rotating (log has already been rotated)830gitlab # [ 8.182305] logrotate[571]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed831gitlab # [ 8.184369] logrotate[571]: switching euid from 0 to 165 and egid from 0 to 165 (pid 571)832gitlab # [ 8.185394] logrotate[571]: considering log /var/gitlab/state/log/*.log833gitlab # [ 8.186316] logrotate[571]: log /var/gitlab/state/log/*.log does not exist -- skipping834gitlab # [ 8.187580] logrotate[571]: Creating new state835gitlab # [ 8.190997] logrotate[571]: switching euid from 165 to 0 and egid from 165 to 0 (pid 571)836gitlab # [ 8.192238] logrotate[571]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed837gitlab # [ 8.193928] logrotate[571]: switching euid from 0 to 60 and egid from 0 to 60 (pid 571)838gitlab # [ 8.195045] logrotate[571]: considering log /var/log/nginx/*.log839gitlab # [ 8.195911] logrotate[571]: log /var/log/nginx/*.log does not exist -- skipping840gitlab # [ 8.197277] logrotate[571]: Creating new state841gitlab # [ 8.198064] logrotate[571]: not running postrotate script, since no logs were rotated842gitlab # [ 8.199253] logrotate[571]: switching euid from 60 to 0 and egid from 60 to 0 (pid 571)843gitlab # [ 8.202480] systemd[1]: Started Reset console on configuration changes.844gitlab # [ 8.203831] nsncd[572]: Aug 16 17:26:24.992 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"845gitlab # [ 8.206305] systemd[1]: Starting resolvconf update...846gitlab # [ 8.207186] systemd[1]: Finished Logrotate configuration check.847gitlab # [ 8.208983] systemd[1]: Finished Post-Boot Actions.848gitlab # [ 8.209898] systemd[1]: Started Name Service Cache Daemon (nsncd).849gitlab # [ 8.210878] systemd[1]: Finished Import lastlog data into lastlog2 database.850gitlab # [ 8.212695] systemd[1]: Reached target Host and Network Name Lookups.851gitlab # [ 8.213677] systemd[1]: Reached target User and Group Name Lookups.852gitlab # [ 8.214558] systemd[1]: Starting User Login Management...853gitlab # [ 8.215359] systemd[1]: Starting Virtual Console Setup...854gitlab # [ 8.235159] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.855gitlab # [ 8.237074] systemd[1]: Stopped Virtual Console Setup.856gitlab # [ 8.242043] systemd[1]: Starting Virtual Console Setup...857gitlab # [ 8.256553] systemd[1]: Stopped target Host and Network Name Lookups.858gitlab # [ 8.257621] systemd[1]: Stopping Host and Network Name Lookups...859gitlab # [ 8.258595] systemd[1]: Stopped target User and Group Name Lookups.860gitlab # [ 8.259827] systemd[1]: Stopping User and Group Name Lookups...861gitlab # [ 8.262170] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...862gitlab # [ 8.263514] systemd[1]: nscd.service: Deactivated successfully.863gitlab # [ 8.264998] systemd[1]: Stopped Name Service Cache Daemon (nsncd).864gitlab # [ 8.266308] systemd[1]: nscd.service: Consumed 23ms CPU time over 125ms wall clock time, 7.4M memory peak, 5.8M read from disk.865gitlab # [ 8.268353] systemd[1]: Starting Name Service Cache Daemon (nsncd)...866gitlab # [ 8.275979] systemd-logind[618]: New seat seat0.867gitlab # [ 8.279919] systemd-logind[618]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)868gitlab # [ 8.285075] systemd-logind[618]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)869gitlab # [ 8.286648] systemd-logind[618]: Watching system buttons on /dev/input/event0 (gpio-keys)870gitlab # [ 8.287743] systemd[1]: Started User Login Management.871gitlab # [ 8.292686] systemd[1]: Starting linger-users.service...872gitlab # [ 8.294467] systemd[1]: Started Name Service Cache Daemon (nsncd).873gitlab # [ 8.296226] systemd[1]: Reached target Host and Network Name Lookups.874gitlab # [ 8.297178] systemd[1]: Reached target User and Group Name Lookups.875gitlab # [ 8.300162] nsncd[666]: Aug 16 17:26:25.113 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"876gitlab # [ 8.306943] systemd-vconsole-setup[656]: Configuration of first virtual console was skipped, ignoring remaining ones.877gitlab # [ 8.312604] systemd[1]: Finished Virtual Console Setup.878gitlab # [ 8.316527] systemd[1]: Finished resolvconf update.879gitlab # [ 8.317545] systemd[1]: Reached target Preparation for Network.880gitlab # [ 8.321557] systemd[1]: Starting DHCP Client...881gitlab # [ 8.324807] systemd[1]: Starting Address configuration of eth1...882gitlab # [ 8.328469] systemd[1]: Starting Extra networking commands....883gitlab # [ 8.330692] systemd[1]: linger-users.service: Deactivated successfully.884gitlab # [ 8.331650] systemd[1]: Finished linger-users.service.885gitlab # [ 8.355352] network-addresses-eth1-start[694]: adding address 192.168.1.1/24... done886gitlab # [ 8.360576] network-addresses-eth1-start[694]: adding address 2001:db8:1::1/64... done887gitlab # [ 8.366002] systemd[1]: Finished Address configuration of eth1.888gitlab # [ 8.408686] dhcpcd[706]: dhcpcd-10.3.2 starting889gitlab # [ 8.410496] systemd[1]: Finished Extra networking commands..890gitlab # [ 8.411735] dhcpcd[759]: dev: loaded udev891gitlab # [ 8.412597] systemd[1]: Reached target Network.892gitlab # [ 8.415423] systemd[1]: Starting gitlab-workhorse.service...893gitlab # [ 8.418097] systemd[1]: Starting Nginx Web Server...894gitlab # [ 8.421058] systemd[1]: Starting PostgreSQL Server...895gitlab # [ 8.430144] 8021q: 802.1Q VLAN Support v1.8896gitlab # [ 8.430489] 8021q: adding VLAN 0 to HW filter on device eth1897gitlab # [ 8.429939] systemd[1]: Starting Redis Server - redis-gitlab...898gitlab # [ 8.432999] systemd[1]: Starting Permit User Sessions...899gitlab # [ 8.447181] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.900gitlab # [ 8.459855] systemd[1]: Finished Permit User Sessions.901gitlab # [ 8.468078] systemd[1]: Started Getty on tty1.902gitlab # [ 8.468795] systemd[1]: Reached target Login Prompts.903gitlab # [ 8.486329] cfg80211: Loading compiled-in X.509 certificates for regulatory database904gitlab # [ 8.492785] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'905gitlab # [ 8.493262] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'906gitlab # [ 8.494674] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2907gitlab # [ 8.495006] cfg80211: failed to load regulatory.db908gitlab # [ 8.551665] 8021q: adding VLAN 0 to HW filter on device eth0909gitlab # [ 8.549247] dhcpcd[759]: eth0: waiting for carrier910gitlab # [ 8.550989] dhcpcd[759]: eth0: carrier acquired911gitlab # [ 8.553140] dhcpcd[759]: DUID 00:01:00:01:32:14:af:41:52:54:00:12:34:56912gitlab # [ 8.554213] dhcpcd[759]: eth0: IAID 00:12:34:56913gitlab # [ 8.554885] dhcpcd[759]: eth0: adding address fe80::5054:ff:fe12:3456914gitlab # [ 8.570394] nginx-pre-start[792]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok915gitlab # [ 8.572047] nginx-pre-start[792]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful916gitlab # [ 8.578871] systemd[1]: Started Nginx Web Server.917gitlab # [ 8.616861] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".918gitlab # [ 8.619271] postgresql-pre-start[791]: This user must also own the server process.919gitlab # [ 8.621228] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.920gitlab # [ 8.623552] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo921gitlab # [ 8.625106] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".922gitlab # [ 8.626497] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".923gitlab # [ 8.627826] postgresql-pre-start[791]: The default text search configuration will be set to "english".924gitlab # [ 8.629220] postgresql-pre-start[791]: Data page checksums are enabled.925gitlab # [ 8.630203] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok926gitlab # [ 8.631535] postgresql-pre-start[791]: creating subdirectories ... ok927gitlab # [ 8.632502] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix928gitlab # [ 8.633760] systemd[1]: Started Redis Server - redis-gitlab.929gitlab # [ 8.634568] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started930gitlab # [ 8.636195] redis-server[789]: Configuration loaded931gitlab # [ 8.637036] redis[789]: monotonic clock: ARM CNTVCT @ 1000 ticks/us932gitlab # [ 8.638151] redis[789]: Running mode=standalone, port=0.933gitlab # [ 8.639225] redis[789]: Server initialized934gitlab # [ 8.640103] redis[789]: Ready to accept connections unix935gitlab # [ 8.641189] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.936gitlab # [ 8.665812] postgresql-pre-start[791]: selecting default "max_connections" ... 100937gitlab # [ 8.726815] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB938gitlab # [ 8.859119] dhcpcd[759]: eth0: soliciting a DHCP lease939gitlab # [ 8.872721] dhcpcd[759]: eth0: offered 10.0.2.15 from 10.0.2.2940gitlab # [ 8.892657] dhcpcd[759]: eth0: probing address 10.0.2.15/24941gitlab # [ 9.019195] systemd[1]: Started gitlab-workhorse.service.942gitlab # [ 9.224950] gitlab-workhorse[821]: time="2026-08-16T17:26:26Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4943gitlab # [ 9.226863] gitlab-workhorse[821]: time="2026-08-16T17:26:26Z" level=info msg="Using redis/go-redis"944gitlab # [ 9.228718] gitlab-workhorse[821]: time="2026-08-16T17:26:26Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix945gitlab # [ 9.257297] postgresql-pre-start[791]: selecting default time zone ... UTC946gitlab # [ 9.261208] postgresql-pre-start[791]: creating configuration files ... ok947gitlab # [ 9.495971] postgresql-pre-start[791]: running bootstrap script ... ok948gitlab # [ 10.219245] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok949gitlab # [ 10.347726] dhcpcd[759]: eth0: soliciting an IPv6 router950gitlab # [ 10.350716] dhcpcd[759]: eth0: Router Advertisement from fe80::2951gitlab # [ 10.354314] dhcpcd[759]: eth0: adding address fec0::5054:ff:fe12:3456/64952gitlab # [ 10.357448] dhcpcd[759]: eth0: adding route to fec0::/64953gitlab # [ 10.359967] dhcpcd[759]: eth0: adding default route via fe80::2954gitlab # [ 10.571960] postgresql-pre-start[791]: syncing data to disk ... ok955gitlab # [ 10.574849] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections956gitlab # [ 10.579047] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.957gitlab # [ 10.585787] postgresql-pre-start[791]: Success. You can now start the database server using:958gitlab # [ 10.589344] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start959gitlab # [ 10.701255] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit960gitlab # [ 10.706777] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432961gitlab # [ 10.710348] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432962gitlab # [ 10.715342] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"963gitlab # [ 10.723306] postgres[869]: [869] LOG: database system was shut down at 2026-08-16 17:26:27 GMT964gitlab # [ 10.730219] postgres[854]: [854] LOG: database system is ready to accept connections965gitlab # [ 10.734367] systemd[1]: Started PostgreSQL Server.966gitlab # [ 10.741180] systemd[1]: Starting PostgreSQL Setup Scripts...967gitlab # [ 10.850119] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[859]: mkdir -p /var/gitlab/state/home/.ssh: OK968gitlab # [ 10.854221] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[859]: chmod 700 /var/gitlab/state/home/.ssh: OK969gitlab # [ 10.961731] systemd[1]: Finished gitlab-config.service.970gitlab # [ 10.968341] systemd[1]: Started gitaly.service.971gitlab # [ 11.078477] postgresql-setup-start[884]: CREATE DATABASE972gitlab # [ 11.136261] postgresql-setup-start[899]: CREATE ROLE973gitlab # [ 11.163259] postgresql-setup-start[901]: ALTER DATABASE974gitlab # [ 11.213333] postgresql-setup-start[911]: CREATE ROLE975gitlab # [ 11.216987] systemd[1]: Finished PostgreSQL Setup Scripts.976gitlab # [ 11.219548] systemd[1]: Reached target PostgreSQL.977gitlab # [ 11.221919] systemd[1]: Starting gitlab-db-config.service...978gitlab # [ 11.226238] systemd[1]: Starting gitlab-postgresql.service...979gitlab # [ 11.380361] gitlab-postgresql-start[922]: CREATE DATABASE980gitlab # [ 11.448776] gitlab-postgresql-start[931]: CREATE EXTENSION981gitlab # [ 11.532290] gitlab-postgresql-start[943]: CREATE EXTENSION982gitlab # [ 11.537533] systemd[1]: Finished gitlab-postgresql.service.983gitlab # [ 11.654136] gitaly[894]: time="2026-08-16T17:26:28.467Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=894984gitlab # [ 11.665230] gitaly[894]: time="2026-08-16T17:26:28.468Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=894985gitlab # [ 11.670050] gitaly[894]: time="2026-08-16T17:26:28.468Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=894986gitlab # [ 11.676325] gitaly[894]: time="2026-08-16T17:26:28.468Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=894987gitlab # [ 11.681438] gitaly[894]: time="2026-08-16T17:26:28.468Z" level=info msg="Starting Gitaly" pid=894 version=988gitlab # [ 11.859640] gitaly[894]: time="2026-08-16T17:26:28.674Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=205 pid=894989gitlab # [ 11.861772] gitaly[894]: time="2026-08-16T17:26:28.674Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=894990gitlab # [ 11.863663] gitaly[894]: time="2026-08-16T17:26:28.674Z" level=info msg="finished initializing command factory" duration_ms=0 pid=894991gitlab # [ 11.865706] gitaly[894]: time="2026-08-16T17:26:28.675Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-894/git-exec-1919210255.d/git pid=894992gitlab # [ 11.873307] gitaly[894]: time="2026-08-16T17:26:28.685Z" level=info msg="finished detecting git version" duration_ms=10 pid=894993gitlab # [ 11.875077] gitaly[894]: time="2026-08-16T17:26:28.685Z" level=info msg="using Git version" pid=894 version=2.53.g994gitlab # [ 11.876532] gitaly[894]: time="2026-08-16T17:26:28.685Z" level=info msg="clearing disk cache object folder" pid=894 storage=default995gitlab # [ 11.878156] gitaly[894]: time="2026-08-16T17:26:28.685Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1320629963 pid=894 storage=default996gitlab # [ 11.880801] gitaly[894]: time="2026-08-16T17:26:28.685Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1320629963 pid=894 storage=default997gitlab # [ 11.883770] gitaly[894]: time="2026-08-16T17:26:28.685Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=894998gitlab # [ 11.891111] gitaly[894]: time="2026-08-16T17:26:28.685Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=894999gitlab # [ 11.893824] gitaly[894]: time="2026-08-16T17:26:28.686Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1320629963 clear_duration_ms=0 pid=894 storage=default1000gitlab # [ 11.908430] gitaly[894]: time="2026-08-16T17:26:28.723Z" level=info msg="counting repositories" pid=8941001gitlab # [ 11.910658] gitaly[894]: time="2026-08-16T17:26:28.725Z" level=info msg="starting to count repositories" pid=894 storage_path=/var/gitlab/state/repositories1002gitlab # [ 11.912573] gitaly[894]: time="2026-08-16T17:26:28.723Z" level=info msg="finished tempdir cleaner walk" pid=894 storage=default time_ms=01003gitlab # [ 11.914165] gitaly[894]: time="2026-08-16T17:26:28.727Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=894 storage_path=/var/gitlab/state/repositories1004gitlab # [ 11.916197] gitaly[894]: time="2026-08-16T17:26:28.727Z" level=info msg="completed counting all repositories" counting_duration=1 pid=8941005gitlab # [ 11.917750] gitaly[894]: time="2026-08-16T17:26:28.723Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8941006gitlab # [ 11.919738] gitaly[894]: time="2026-08-16T17:26:28.727Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=894 schema=unix1007gitlab # [ 11.921761] gitaly[894]: time="2026-08-16T17:26:28.727Z" level=info msg="listening at address" address=/run/gitaly/gitaly-894/sock.d/intern pid=894 schema=unix1008gitlab # [ 11.923539] gitaly[894]: time="2026-08-16T17:26:28.729Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8941009gitlab # [ 11.925175] gitaly[894]: time="2026-08-16T17:26:28.729Z" level=info msg="Started Gitaly" duration_ms=260 pid=8941010gitlab # [ 11.926478] gitaly[894]: time="2026-08-16T17:26:28.729Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8941011gitlab # [ 11.927990] gitaly[894]: time="2026-08-16T17:26:28.729Z" level=info msg="maintenance: daily scheduled" pid=894 scheduled="2026-08-17 12:00:00 +0000 UTC"1012gitlab # [ 12.491144] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1013gitlab # [ 12.495190] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1014gitlab # [ 12.511548] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1015gitlab # [ 13.250581] dhcpcd[759]: eth0: leased 10.0.2.15 for 86400 seconds1016gitlab # [ 13.250952] dhcpcd[759]: eth0: adding route to 10.0.2.0/241017gitlab # [ 13.251182] dhcpcd[759]: eth0: adding default route via 10.0.2.21018gitlab # [ 13.423050] systemd[1]: Started DHCP Client.1019gitlab # [ 13.425532] systemd[1]: Reached target Network is Online.1020gitlab # [ 15.324184] gitaly[894]: time="2026-08-16T17:26:32.137Z" level=info msg="License database preloaded" duration_ms=3669 pid=8941021gitlab # [ 56.873485] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[917]: W, [2026-08-16T17:27:13.686652 #917] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1022gitlab # [ 59.320829] gitlab-workhorse[821]: time="2026-08-16T17:27:16Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1023gitlab # [ 60.711121] postgres[1441]: [1441] ERROR: relation "feature_gates" does not exist at character 5231024gitlab # [ 60.711567] postgres[1441]: [1441] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1025gitlab # [ 60.711698] postgres[1441]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1026gitlab # [ 60.711821] postgres[1441]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1027gitlab # [ 60.711921] postgres[1441]: attidentity AS identity,1028gitlab # [ 60.728412] postgres[1441]: attgenerated as attgenerated1029gitlab # [ 60.730894] postgres[1441]: FROM pg_attribute a1030gitlab # [ 60.733035] postgres[1441]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1031gitlab # [ 60.736797] postgres[1441]: LEFT JOIN pg_type t ON a.atttypid = t.oid1032gitlab # [ 60.739497] postgres[1441]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1033gitlab # [ 60.743704] postgres[1441]: WHERE a.attrelid = '"feature_gates"'::regclass1034gitlab # [ 60.746614] postgres[1441]: AND a.attnum > 0 AND NOT a.attisdropped1035gitlab # [ 60.749337] postgres[1441]: ORDER BY a.attnum1036gitlab # [ 60.751210] postgres[1441]:1037gitlab # [ 65.834045] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1492]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1038gitlab # [ 65.834402] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1492]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1039gitlab # [ 69.322412] gitlab-workhorse[821]: time="2026-08-16T17:27:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 79.330051] gitlab-workhorse[821]: time="2026-08-16T17:27:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 89.340826] gitlab-workhorse[821]: time="2026-08-16T17:27:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 91.331501] postgres[1586]: [1586] ERROR: relation "table_without_models" does not exist1043gitlab # [ 91.331887] postgres[1586]: [1586] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1044gitlab # [ 99.351901] gitlab-workhorse[821]: time="2026-08-16T17:27:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 109.357390] gitlab-workhorse[821]: time="2026-08-16T17:28:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1046gitlab # [ 119.366335] gitlab-workhorse[821]: time="2026-08-16T17:28:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1047gitlab # [ 122.906241] systemd[1]: Finished gitlab-db-config.service.1048gitlab # [ 122.910776] systemd[1]: Started gitlab-sidekiq.service.1049gitlab # [ 122.914164] systemd[1]: Starting gitlab.service...1050gitlab # [ 123.545522] bundle[1970]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1051gitlab # [ 123.551894] bundle[1970]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1052gitlab # [ 123.558061] bundle[1970]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1053gitlab # [ 128.198897] sidekiq-cluster[1969]: {"severity":"INFO","time":"2026-08-16T17:28:24.973Z","message":"Starting cluster with 1 processes"}1054gitlab # [ 128.246033] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.030Z","pid":1970,"message":"* Enabling systemd notification integration"}1055gitlab # [ 128.251081] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"Puma starting in cluster mode..."}1056gitlab # [ 128.255567] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1057gitlab # [ 128.260329] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1058gitlab # [ 128.266093] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Min threads: 0"}1059gitlab # [ 128.270026] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Max threads: 4"}1060gitlab # [ 128.274069] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Environment: production"}1061gitlab # [ 128.278271] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Master PID: 1970"}1062gitlab # [ 128.282322] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Workers: 2"}1063gitlab # [ 128.286221] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1064gitlab # [ 128.291272] bundle[1970]: {"timestamp":"2026-08-16T17:28:25.060Z","pid":1970,"message":"* Preloading application"}1065gitlab # [ 129.369444] gitlab-workhorse[821]: time="2026-08-16T17:28:26Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 139.384472] gitlab-workhorse[821]: time="2026-08-16T17:28:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 149.385585] gitlab-workhorse[821]: time="2026-08-16T17:28:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 159.396153] gitlab-workhorse[821]: time="2026-08-16T17:28:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 166.588821] bundle[1970]: W, [2026-08-16T17:29:03.402358 #1970] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 169.406286] gitlab-workhorse[821]: time="2026-08-16T17:29:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1071gitlab # [ 170.564529] sidekiq-cluster[2019]: 2026-08-16T17:29:07.378Z pid=2019 tid=wnf INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2019, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434434048}1072gitlab # [ 170.864111] sidekiq-cluster[2019]: W, [2026-08-16T17:29:07.678689 #2019] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1073gitlab # [ 170.923550] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:07.738Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1074gitlab # [ 174.761716] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.575Z","message":"GitLab reliable fetch activated!"}1075gitlab # [ 174.762113] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.575Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1076gitlab # [ 174.795363] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.610Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1077gitlab # [ 174.802538] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.612Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1078gitlab # [ 174.809669] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.615Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1079gitlab # [ 174.816337] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.618Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1080gitlab # [ 174.824852] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.620Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1081gitlab # [ 174.831558] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.623Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1082gitlab # [ 174.838519] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.625Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1083gitlab # [ 174.844658] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.627Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1084gitlab # [ 174.850045] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.629Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1085gitlab # [ 174.855070] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.631Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1086gitlab # [ 174.860252] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.633Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1087gitlab # [ 174.864892] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.636Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1088gitlab # [ 174.868904] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.638Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1089gitlab # [ 174.872965] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.641Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1090gitlab # [ 174.876760] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.643Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1091gitlab # [ 174.880367] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.645Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1092gitlab # [ 174.883589] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.648Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1093gitlab # [ 174.886811] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.650Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1094gitlab # [ 174.890198] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.653Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1095gitlab # [ 174.893211] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.656Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1096gitlab # [ 174.896352] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.659Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1097gitlab # [ 174.899501] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.661Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1098gitlab # [ 174.902389] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.663Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1099gitlab # [ 174.905205] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.666Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1100gitlab # [ 174.907918] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.668Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1101gitlab # [ 174.910657] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.671Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1102gitlab # [ 174.913130] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.674Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1103gitlab # [ 174.915518] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.676Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1104gitlab # [ 174.918121] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.679Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1105gitlab # [ 174.920581] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.682Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1106gitlab # [ 174.922774] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.685Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1107gitlab # [ 174.925292] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.688Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1108gitlab # [ 174.927409] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.691Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1109gitlab # [ 174.929955] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.694Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1110gitlab # [ 174.932162] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.696Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1111gitlab # [ 174.934301] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.698Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1112gitlab # [ 174.936507] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.701Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1113gitlab # [ 174.938568] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.704Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1114gitlab # [ 174.940715] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.706Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1115gitlab # [ 174.942781] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.708Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1116gitlab # [ 174.945097] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.710Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1117gitlab # [ 174.947497] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.712Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1118gitlab # [ 174.949971] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.719Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1119gitlab # [ 174.952058] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.722Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1120gitlab # [ 174.954218] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.724Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1121gitlab # [ 174.956498] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.727Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1122gitlab # [ 174.958608] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.729Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1123gitlab # [ 174.960866] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.732Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1124gitlab # [ 174.962981] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.734Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1125gitlab # [ 174.965260] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.736Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1126gitlab # [ 174.967556] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.739Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1127gitlab # [ 174.969845] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.742Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1128gitlab # [ 174.971967] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.754Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1129gitlab # [ 174.974579] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.757Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1130gitlab # [ 174.976856] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.760Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1131gitlab # [ 174.979019] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.762Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1132gitlab # [ 174.981430] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.765Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1133gitlab # [ 174.983757] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.767Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1134gitlab # [ 174.986207] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.769Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1135gitlab # [ 174.988540] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.771Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1136gitlab # [ 174.990578] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.773Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1137gitlab # [ 174.992679] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.775Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1138gitlab # [ 174.994751] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.778Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1139gitlab # [ 174.996921] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.780Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1140gitlab # [ 174.999058] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.783Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1141gitlab # [ 175.001248] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.786Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1142gitlab # [ 175.003281] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.788Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1143gitlab # [ 175.005583] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.790Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1144gitlab # [ 175.007827] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.792Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1145gitlab # [ 175.010314] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.793Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1146gitlab # [ 175.012585] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.795Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1147gitlab # [ 175.014813] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.797Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1148gitlab # [ 175.017114] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.799Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1149gitlab # [ 175.019407] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.800Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1150gitlab # [ 175.021861] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.802Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1151gitlab # [ 175.024186] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.804Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1152gitlab # [ 175.027457] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.806Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1153gitlab # [ 175.030105] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.808Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1154gitlab # [ 175.032285] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.810Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1155gitlab # [ 175.034311] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.812Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1156gitlab # [ 175.036626] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.814Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1157gitlab # [ 175.038906] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.815Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1158gitlab # [ 175.041265] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.818Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1159gitlab # [ 175.043386] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.820Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1160gitlab # [ 175.045838] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.822Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1161gitlab # [ 175.048042] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.824Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1162gitlab # [ 175.050306] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.827Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1163gitlab # [ 175.052599] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.829Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1164gitlab # [ 175.054826] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.831Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1165gitlab # [ 175.057145] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.833Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1166gitlab # [ 175.059371] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.834Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1167gitlab # [ 175.061722] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.836Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1168gitlab # [ 175.063943] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.838Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1169gitlab # [ 175.066555] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.840Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1170gitlab # [ 175.068580] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.843Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1171gitlab # [ 175.070886] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.845Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1172gitlab # [ 175.073226] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.848Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1173gitlab # [ 175.075372] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.849Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1174gitlab # [ 175.077647] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.860Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1175gitlab # [ 175.079765] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.862Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1176gitlab # [ 175.082031] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.864Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1177gitlab # [ 175.084255] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.867Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1178gitlab # [ 175.086257] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.869Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1179gitlab # [ 175.088437] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.872Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1180gitlab # [ 175.116551] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.929Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1181gitlab # [ 175.118967] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.933Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1182gitlab # [ 175.121163] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.935Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1183gitlab # [ 175.123398] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.938Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1184gitlab # [ 175.126201] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:11.941Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1185gitlab # [ 179.414183] gitlab-workhorse[821]: time="2026-08-16T17:29:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 189.425011] gitlab-workhorse[821]: time="2026-08-16T17:29:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 199.436711] gitlab-workhorse[821]: time="2026-08-16T17:29:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 209.441923] gitlab-workhorse[821]: time="2026-08-16T17:29:46Z" level=error correlation_id= duration_ms=3 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 212.820316] postgres[2739]: [2739] ERROR: relation "table_without_models" does not exist1190gitlab # [ 212.820681] postgres[2739]: [2739] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 216.813244] postgres[2769]: [2769] ERROR: relation "table_without_models" does not exist1192gitlab # [ 216.813577] postgres[2769]: [2769] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1193gitlab # [ 217.629233] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:54.438Z","message":"Booted Rails 7.2.3.1 application in production environment"}1194gitlab # [ 217.638100] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:54.452Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1195gitlab # [ 217.644458] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:54.453Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1196gitlab # [ 217.649815] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:54.453Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1197gitlab # [ 217.656006] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:54.456Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1198gitlab # [ 219.447000] gitlab-workhorse[821]: time="2026-08-16T17:29:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1199gitlab # [ 220.300981] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:57.114Z","message":"Cleaning working queues"}1200gitlab # [ 220.303804] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:57.117Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1c3963d269c7f2cb7563bb8d","created_at":"2026-08-16T17:28:18.923Z","trace_propagation_headers":{"sentry-trace":"7cc85e5d787044db9da58cd5e3b42f33-72906487a1c244d6","baggage":"sentry-trace_id=7cc85e5d787044db9da58cd5e3b42f33,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6ca5988ba17efd2a979c20fb07f39ea0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.935Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1c3963d269c7f2cb7563bb8d: start","job_status":"start","queue_duration_s":98.182567,"scheduling_latency_s":98.182687}1201gitlab # [ 220.662657] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:29:57.476Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1c3963d269c7f2cb7563bb8d","created_at":"2026-08-16T17:28:18.923Z","trace_propagation_headers":{"sentry-trace":"7cc85e5d787044db9da58cd5e3b42f33-72906487a1c244d6","baggage":"sentry-trace_id=7cc85e5d787044db9da58cd5e3b42f33,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"6ca5988ba17efd2a979c20fb07f39ea0","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:28:18.935Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1c3963d269c7f2cb7563bb8d: done: 0.359235 sec","job_status":"done","queue_duration_s":98.182567,"scheduling_latency_s":98.182687,"redis_calls":29,"redis_duration_s":0.012885,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007076,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003414,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002395,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.176081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18075902,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.359235,"completed_at":"2026-08-16T17:29:57.476Z","load_balancing_strategy":"primary","db_duration_s":0.099083,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1202gitlab # [ 223.259461] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.073Z","pid":1970,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1203gitlab # [ 223.259821] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.073Z","pid":1970,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1204gitlab # [ 223.259950] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.073Z","pid":1970,"message":"! #\u003cThread:0x0000f3cfe693a0f8 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1205gitlab # [ 223.260211] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.073Z","pid":1970,"message":"! #\u003cThread:0x0000f3cfe6b34b60 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1206gitlab # [ 223.260333] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.073Z","pid":1970,"message":"Use Ctrl-C to stop"}1207gitlab # [ 223.260445] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.073Z","pid":1970,"message":"Sending status to systemd every 1.0 sec"}1208gitlab # [ 223.821242] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.635Z","pid":1970,"message":"- Worker 0 (PID: 2887) booted in 0.53s, phase: 0"}1209gitlab # [ 223.827306] bundle[1970]: {"timestamp":"2026-08-16T17:30:00.635Z","pid":1970,"message":"- Worker 1 (PID: 2891) booted in 0.51s, phase: 0"}1210gitlab # [ 223.833551] systemd[1]: Started gitlab.service.1211gitlab # [ 223.835711] systemd[1]: Reached target Common target for all GitLab services..1212gitlab # [ 223.840986] systemd[1]: Starting setup-gitlab.service...1213gitlab # [ 223.883039] setup-gitlab-start[2919]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1214gitlab # [ 227.756815] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:30:04 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 38331215gitlab # [ 227.762941] setup-gitlab-start[2919]: + TOKEN=nixbot-test-token-of-20-chars1216gitlab # [ 227.763961] setup-gitlab-start[2919]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1217gitlab # [ 227.780985] runuser[2941]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1218gitlab # [ 228.298532] setup-gitlab-start[2942]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1219gitlab # [ 228.305975] setup-gitlab-start[2942]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1220gitlab # [ 228.312695] setup-gitlab-start[2942]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1221gitlab # [ 229.114533] setup-gitlab-start[2942]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1222gitlab # [ 229.114904] setup-gitlab-start[2942]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1223gitlab # [ 229.117170] setup-gitlab-start[2942]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1224gitlab # [ 234.929603] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:11.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"dbc7ff6f363afb6f07805f8c","created_at":"2026-08-16T17:30:11.609Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37db55c623b157d59b5af12c9bf04f41","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.739Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-dbc7ff6f363afb6f07805f8c: start","job_status":"start","queue_duration_s":0.003139,"scheduling_latency_s":0.003184}1225gitlab # [ 235.360740] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"dbc7ff6f363afb6f07805f8c","created_at":"2026-08-16T17:30:11.609Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37db55c623b157d59b5af12c9bf04f41","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.739Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-dbc7ff6f363afb6f07805f8c: done: 0.427094 sec","job_status":"done","queue_duration_s":0.003139,"scheduling_latency_s":0.003184,"redis_calls":10,"redis_duration_s":0.049002,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004459,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.032393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.01215,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01048126,"duration_s":0.427094,"completed_at":"2026-08-16T17:30:12.169Z","load_balancing_strategy":"primary","db_duration_s":0.112898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1226gitlab # [ 235.441687] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"f67b31da8b0b382ec2d9893c","created_at":"2026-08-16T17:30:11.789Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdfc9070a9d51a018fe6022f641b1d6f","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.829Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-f67b31da8b0b382ec2d9893c: start","job_status":"start","queue_duration_s":0.403068,"scheduling_latency_s":0.403232}1227gitlab # [ 235.678102] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"f67b31da8b0b382ec2d9893c","created_at":"2026-08-16T17:30:11.789Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdfc9070a9d51a018fe6022f641b1d6f","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.829Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-f67b31da8b0b382ec2d9893c: done: 0.257171 sec","job_status":"done","queue_duration_s":0.403068,"scheduling_latency_s":0.403232,"redis_calls":10,"redis_duration_s":0.043115,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00345,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.033513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006152,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00937156,"duration_s":0.257171,"completed_at":"2026-08-16T17:30:12.489Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035042,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1228gitlab # [ 235.763801] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.499Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"accc7fcc80d02b7e00a7b7fe","created_at":"2026-08-16T17:30:11.865Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54241f8f0a03932a3528fe51930c72da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.884Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-accc7fcc80d02b7e00a7b7fe: start","job_status":"start","queue_duration_s":0.6154,"scheduling_latency_s":0.615453}1229gitlab # [ 235.895369] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"accc7fcc80d02b7e00a7b7fe","created_at":"2026-08-16T17:30:11.865Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54241f8f0a03932a3528fe51930c72da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.884Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-accc7fcc80d02b7e00a7b7fe: done: 0.207524 sec","job_status":"done","queue_duration_s":0.6154,"scheduling_latency_s":0.615453,"redis_calls":12,"redis_duration_s":0.012745999999999999,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002918,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001671,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00422304,"duration_s":0.207524,"completed_at":"2026-08-16T17:30:12.707Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 235.988783] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"43035558e400aaa8feceb32c","created_at":"2026-08-16T17:30:11.915Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4abee0b5b33c3ee7da518d325deed994","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.933Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-43035558e400aaa8feceb32c: start","job_status":"start","queue_duration_s":0.781951,"scheduling_latency_s":0.782005}1231gitlab # [ 236.054147] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.867Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"43035558e400aaa8feceb32c","created_at":"2026-08-16T17:30:11.915Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4abee0b5b33c3ee7da518d325deed994","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.933Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-43035558e400aaa8feceb32c: done: 0.152365 sec","job_status":"done","queue_duration_s":0.781951,"scheduling_latency_s":0.782005,"redis_calls":10,"redis_duration_s":0.005711,"redis_read_bytes":9,"redis_write_bytes":995,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000758,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003588,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":192,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009603,"duration_s":0.152365,"completed_at":"2026-08-16T17:30:12.867Z","load_balancing_strategy":"primary","db_duration_s":0.034607,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 236.136407] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:12.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b1596f126a5f435d403f217b","created_at":"2026-08-16T17:30:11.975Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fd8c394fe87b8cb7124030c3ff03e1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.997Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b1596f126a5f435d403f217b: start","job_status":"start","queue_duration_s":0.878353,"scheduling_latency_s":0.87841}1233gitlab # [ 238.093744] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:14.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"b1596f126a5f435d403f217b","created_at":"2026-08-16T17:30:11.975Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0fd8c394fe87b8cb7124030c3ff03e1a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:11.997Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-b1596f126a5f435d403f217b: done: 2.029948 sec","job_status":"done","queue_duration_s":0.878353,"scheduling_latency_s":0.87841,"redis_calls":14,"redis_duration_s":0.034204,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.012942,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009478,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.35,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.35,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.982249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00583404,"exclusive_lock_hold_duration_s":1.7316026999999998,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":2.029948,"completed_at":"2026-08-16T17:30:14.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.780455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234gitlab # [ 238.179815] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:14.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"97f91716a5bf9df99cdd1ea8","created_at":"2026-08-16T17:30:12.048Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ebe0bf6c4bd7ac96097e475b467acb4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.099Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-97f91716a5bf9df99cdd1ea8: start","job_status":"start","queue_duration_s":2.815274,"scheduling_latency_s":2.815323}1235gitlab # [ 238.250372] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"97f91716a5bf9df99cdd1ea8","created_at":"2026-08-16T17:30:12.048Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ebe0bf6c4bd7ac96097e475b467acb4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.099Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-97f91716a5bf9df99cdd1ea8: done: 0.149581 sec","job_status":"done","queue_duration_s":2.815274,"scheduling_latency_s":2.815323,"redis_calls":10,"redis_duration_s":0.008099,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000711,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003043,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069022,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.149581,"completed_at":"2026-08-16T17:30:15.063Z","load_balancing_strategy":"primary","db_duration_s":0.054314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 238.377364] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"350b7dbfc746ae5616b21fd2","created_at":"2026-08-16T17:30:12.148Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0664e13fe1300dfac0814d1615e4454","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.248Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-350b7dbfc746ae5616b21fd2: start","job_status":"start","queue_duration_s":2.818673,"scheduling_latency_s":2.818717}1237gitlab # [ 238.397208] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"350b7dbfc746ae5616b21fd2","created_at":"2026-08-16T17:30:12.148Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e0664e13fe1300dfac0814d1615e4454","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.248Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-350b7dbfc746ae5616b21fd2: done: 0.034882 sec","job_status":"done","queue_duration_s":2.818673,"scheduling_latency_s":2.818717,"redis_calls":11,"redis_duration_s":0.002554,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042058,"duration_s":0.034882,"completed_at":"2026-08-16T17:30:15.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 238.442529] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c1a06dc4b4ff446189ee9285","created_at":"2026-08-16T17:30:12.287Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5e0ac9a569c55164c836a2c06815e53","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.330Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c1a06dc4b4ff446189ee9285: start","job_status":"start","queue_duration_s":2.772424,"scheduling_latency_s":2.772447}1239gitlab # [ 238.457255] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c1a06dc4b4ff446189ee9285","created_at":"2026-08-16T17:30:12.287Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5e0ac9a569c55164c836a2c06815e53","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.330Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c1a06dc4b4ff446189ee9285: done: 0.037538 sec","job_status":"done","queue_duration_s":2.772424,"scheduling_latency_s":2.772447,"redis_calls":13,"redis_duration_s":0.002246,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000372,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01104946,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.037538,"completed_at":"2026-08-16T17:30:15.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002827,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1240gitlab # [ 238.502689] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2e82f5e9f244d00c6afb5fe9","created_at":"2026-08-16T17:30:12.389Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"291bc78f4231d8e30bb5de6f2a7f3c9a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:30:12.437Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2e82f5e9f244d00c6afb5fe9: start","job_status":"start","queue_duration_s":2.70443,"scheduling_latency_s":2.704453}1241gitlab # [ 238.516174] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.154Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1242gitlab # [ 238.519279] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2e82f5e9f244d00c6afb5fe9","created_at":"2026-08-16T17:30:12.389Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"291bc78f4231d8e30bb5de6f2a7f3c9a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:30:12.437Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2e82f5e9f244d00c6afb5fe9: done: 0.023026 sec","job_status":"done","queue_duration_s":2.70443,"scheduling_latency_s":2.704453,"redis_calls":10,"redis_duration_s":0.0040100000000000005,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034282,"duration_s":0.023026,"completed_at":"2026-08-16T17:30:15.165Z","load_balancing_strategy":"primary","db_duration_s":0.000325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 238.560728] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c5c0e71a69a32c13da765753","created_at":"2026-08-16T17:30:12.479Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.519Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c5c0e71a69a32c13da765753: start","job_status":"start","queue_duration_s":2.647096,"scheduling_latency_s":2.647113}1244gitlab # [ 238.574149] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"c5c0e71a69a32c13da765753","created_at":"2026-08-16T17:30:12.479Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.519Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-c5c0e71a69a32c13da765753: done: 0.034781 sec","job_status":"done","queue_duration_s":2.647096,"scheduling_latency_s":2.647113,"redis_calls":19,"redis_duration_s":0.002599,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000577,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000284,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001311,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000427,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002269,"duration_s":0.034781,"completed_at":"2026-08-16T17:30:15.201Z","load_balancing_strategy":"primary","db_duration_s":0.001643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 238.616735] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"bbb5d24e472f0cc799adeb54","created_at":"2026-08-16T17:30:12.590Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3729239a4f695cac53a6ba67846d1aba","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.638Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-bbb5d24e472f0cc799adeb54: start","job_status":"start","queue_duration_s":2.564504,"scheduling_latency_s":2.564522}1246gitlab # [ 238.631323] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"bbb5d24e472f0cc799adeb54","created_at":"2026-08-16T17:30:12.590Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3729239a4f695cac53a6ba67846d1aba","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.638Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-bbb5d24e472f0cc799adeb54: done: 0.02532 sec","job_status":"done","queue_duration_s":2.564504,"scheduling_latency_s":2.564522,"redis_calls":13,"redis_duration_s":0.002045,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000701,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039088,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.02532,"completed_at":"2026-08-16T17:30:15.227Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 238.676182] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e823d949e20994dd79f5c95d","created_at":"2026-08-16T17:30:12.696Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7849e7fcc1ae0397469bdba3e920832c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.727Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e823d949e20994dd79f5c95d: start","job_status":"start","queue_duration_s":2.501483,"scheduling_latency_s":2.501509}1248gitlab # [ 238.690370] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.240Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1249gitlab # [ 238.693531] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e823d949e20994dd79f5c95d","created_at":"2026-08-16T17:30:12.696Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7849e7fcc1ae0397469bdba3e920832c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.727Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e823d949e20994dd79f5c95d: done: 0.018501 sec","job_status":"done","queue_duration_s":2.501483,"scheduling_latency_s":2.501509,"redis_calls":10,"redis_duration_s":0.001345,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000767,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025498,"duration_s":0.018501,"completed_at":"2026-08-16T17:30:15.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 238.737366] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"68e76bf19f687147357ea5cf","created_at":"2026-08-16T17:30:12.801Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a07efd180274b0d458ad46f128a3cd3","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.859Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-68e76bf19f687147357ea5cf: start","job_status":"start","queue_duration_s":2.388921,"scheduling_latency_s":2.388941}1251gitlab # [ 238.751777] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"68e76bf19f687147357ea5cf","created_at":"2026-08-16T17:30:12.801Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a07efd180274b0d458ad46f128a3cd3","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.859Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-68e76bf19f687147357ea5cf: done: 0.024096 sec","job_status":"done","queue_duration_s":2.388921,"scheduling_latency_s":2.388941,"redis_calls":10,"redis_duration_s":0.001403,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022526,"duration_s":0.024096,"completed_at":"2026-08-16T17:30:15.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 238.794222] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.274Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"519be80db5967eade26cb1ae","created_at":"2026-08-16T17:30:12.891Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77858d4ae407e8e133c129aa8d7e72f4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.923Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-519be80db5967eade26cb1ae: start","job_status":"start","queue_duration_s":2.350981,"scheduling_latency_s":2.350996}1253gitlab # [ 238.808567] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"519be80db5967eade26cb1ae","created_at":"2026-08-16T17:30:12.891Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77858d4ae407e8e133c129aa8d7e72f4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:12.923Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-519be80db5967eade26cb1ae: done: 0.021262 sec","job_status":"done","queue_duration_s":2.350981,"scheduling_latency_s":2.350996,"redis_calls":12,"redis_duration_s":0.001619,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047066,"exclusive_lock_hold_duration_s":0.00285798,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021262,"completed_at":"2026-08-16T17:30:15.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 238.851682] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"12cce5e126cabafd606c673b","created_at":"2026-08-16T17:30:12.985Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6cc5b69fa1b98a0af699b3dfc8dd2fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:30:13.051Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-12cce5e126cabafd606c673b: start","job_status":"start","queue_duration_s":2.245193,"scheduling_latency_s":2.245208}1255gitlab # [ 238.865017] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"12cce5e126cabafd606c673b","created_at":"2026-08-16T17:30:12.985Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6cc5b69fa1b98a0af699b3dfc8dd2fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:30:13.051Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-12cce5e126cabafd606c673b: done: 0.042787 sec","job_status":"done","queue_duration_s":2.245193,"scheduling_latency_s":2.245208,"redis_calls":10,"redis_duration_s":0.002103,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054494,"duration_s":0.042787,"completed_at":"2026-08-16T17:30:15.339Z","load_balancing_strategy":"primary","db_duration_s":0.003014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 238.905953] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"7f86e641feee6022dcaf36bc","created_at":"2026-08-16T17:30:13.127Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"425bd742fa207d428faa00604cb91f7d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.263Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-7f86e641feee6022dcaf36bc: start","job_status":"start","queue_duration_s":2.079154,"scheduling_latency_s":2.079202}1257gitlab # [ 238.920874] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"7f86e641feee6022dcaf36bc","created_at":"2026-08-16T17:30:13.127Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"425bd742fa207d428faa00604cb91f7d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.263Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-7f86e641feee6022dcaf36bc: done: 0.056916 sec","job_status":"done","queue_duration_s":2.079154,"scheduling_latency_s":2.079202,"redis_calls":10,"redis_duration_s":0.003358,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001941,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069516,"duration_s":0.056916,"completed_at":"2026-08-16T17:30:15.399Z","load_balancing_strategy":"primary","db_duration_s":0.000647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 238.962306] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"00b47f3bafaed249bd3ecea5","created_at":"2026-08-16T17:30:13.311Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad28030bdf4c4e8e93ea245b5d0e3b68","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.336Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-00b47f3bafaed249bd3ecea5: start","job_status":"start","queue_duration_s":2.066006,"scheduling_latency_s":2.066035}1259gitlab # [ 238.976835] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"00b47f3bafaed249bd3ecea5","created_at":"2026-08-16T17:30:13.311Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad28030bdf4c4e8e93ea245b5d0e3b68","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.336Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-00b47f3bafaed249bd3ecea5: done: 0.078351 sec","job_status":"done","queue_duration_s":2.066006,"scheduling_latency_s":2.066035,"redis_calls":20,"redis_duration_s":0.013666000000000001,"redis_read_bytes":23,"redis_write_bytes":4316,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.00365,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.001591,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2021,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.004301,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004124,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00095568,"duration_s":0.078351,"completed_at":"2026-08-16T17:30:15.480Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003918,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 239.020673] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fadf8348913ee29547f43e2b","created_at":"2026-08-16T17:30:13.354Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e5eb4da16301fd882b7f94ab1d23543","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.373Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fadf8348913ee29547f43e2b: start","job_status":"start","queue_duration_s":2.108566,"scheduling_latency_s":2.108587}1261gitlab # [ 239.035327] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.559Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fadf8348913ee29547f43e2b","created_at":"2026-08-16T17:30:13.354Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e5eb4da16301fd882b7f94ab1d23543","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.373Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fadf8348913ee29547f43e2b: done: 0.076793 sec","job_status":"done","queue_duration_s":2.108566,"scheduling_latency_s":2.108587,"redis_calls":12,"redis_duration_s":0.004217,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00110612,"exclusive_lock_hold_duration_s":0.0267507,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.076793,"completed_at":"2026-08-16T17:30:15.559Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 239.080108] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"46999739864c6d2feb7d7aa1","created_at":"2026-08-16T17:30:13.392Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e989de5eb9dadf851643ab8adbe2672","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.410Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-46999739864c6d2feb7d7aa1: start","job_status":"start","queue_duration_s":2.151311,"scheduling_latency_s":2.151337}1263gitlab # [ 239.097377] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.911Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"46999739864c6d2feb7d7aa1","created_at":"2026-08-16T17:30:13.392Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e989de5eb9dadf851643ab8adbe2672","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.410Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-46999739864c6d2feb7d7aa1: done: 0.349899 sec","job_status":"done","queue_duration_s":2.151311,"scheduling_latency_s":2.151337,"redis_calls":565,"redis_duration_s":0.083436,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.081569,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.300722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025244,"duration_s":0.349899,"completed_at":"2026-08-16T17:30:15.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 239.141024] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3447d67c56942ec83cf32b7d","created_at":"2026-08-16T17:30:13.449Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51545c846eef12ff8a438e755d640c46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:30:13.468Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3447d67c56942ec83cf32b7d: start","job_status":"start","queue_duration_s":2.44433,"scheduling_latency_s":2.444345}1265gitlab # [ 239.154293] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.924Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1266gitlab # [ 239.157972] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.932Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3447d67c56942ec83cf32b7d","created_at":"2026-08-16T17:30:13.449Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51545c846eef12ff8a438e755d640c46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:30:13.468Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3447d67c56942ec83cf32b7d: done: 0.01945 sec","job_status":"done","queue_duration_s":2.44433,"scheduling_latency_s":2.444345,"redis_calls":10,"redis_duration_s":0.0019579999999999997,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000392,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028846,"duration_s":0.01945,"completed_at":"2026-08-16T17:30:15.932Z","load_balancing_strategy":"primary","db_duration_s":0.00045,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267gitlab # [ 239.198716] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.933Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"529888342c13423db1b7bcc7","created_at":"2026-08-16T17:30:13.522Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3e2623439c9f9f4170b18035cee5f9e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.565Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-529888342c13423db1b7bcc7: start","job_status":"start","queue_duration_s":2.368515,"scheduling_latency_s":2.368532}1268gitlab # [ 239.212815] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.958Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"529888342c13423db1b7bcc7","created_at":"2026-08-16T17:30:13.522Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3e2623439c9f9f4170b18035cee5f9e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.565Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-529888342c13423db1b7bcc7: done: 0.024652 sec","job_status":"done","queue_duration_s":2.368515,"scheduling_latency_s":2.368532,"redis_calls":10,"redis_duration_s":0.002168,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000408,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000468,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034684,"duration_s":0.024652,"completed_at":"2026-08-16T17:30:15.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 239.256051] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"bcd5165ead7da783a8771304","created_at":"2026-08-16T17:30:13.612Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75c6110a474caab074014836c98e9a84","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.669Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-bcd5165ead7da783a8771304: start","job_status":"start","queue_duration_s":2.290564,"scheduling_latency_s":2.290582}1270gitlab # [ 239.269967] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"bcd5165ead7da783a8771304","created_at":"2026-08-16T17:30:13.612Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75c6110a474caab074014836c98e9a84","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.669Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-bcd5165ead7da783a8771304: done: 0.028556 sec","job_status":"done","queue_duration_s":2.290564,"scheduling_latency_s":2.290582,"redis_calls":17,"redis_duration_s":0.004404,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002201,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000353,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033224,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.028556,"completed_at":"2026-08-16T17:30:15.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 239.313345] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:15.989Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8331ae20e5d1ceb2935dcc8b","created_at":"2026-08-16T17:30:13.743Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc79aff36aa419b541191398419e7105","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.786Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8331ae20e5d1ceb2935dcc8b: start","job_status":"start","queue_duration_s":2.20315,"scheduling_latency_s":2.203164}1272gitlab # [ 239.328549] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.016Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8331ae20e5d1ceb2935dcc8b","created_at":"2026-08-16T17:30:13.743Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cc79aff36aa419b541191398419e7105","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.786Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8331ae20e5d1ceb2935dcc8b: done: 0.027131 sec","job_status":"done","queue_duration_s":2.20315,"scheduling_latency_s":2.203164,"redis_calls":10,"redis_duration_s":0.0024590000000000002,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001471,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003617,"duration_s":0.027131,"completed_at":"2026-08-16T17:30:16.016Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006076,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 239.372393] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"b50044b56a5d6218a10e1c3f","created_at":"2026-08-16T17:30:13.857Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c6986c0fabf2e0cb867e1e785db0854","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.906Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-b50044b56a5d6218a10e1c3f: start","job_status":"start","queue_duration_s":2.112488,"scheduling_latency_s":2.112504}1274gitlab # [ 239.385547] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.042Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"b50044b56a5d6218a10e1c3f","created_at":"2026-08-16T17:30:13.857Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c6986c0fabf2e0cb867e1e785db0854","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:13.906Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-b50044b56a5d6218a10e1c3f: done: 0.02341 sec","job_status":"done","queue_duration_s":2.112488,"scheduling_latency_s":2.112504,"redis_calls":10,"redis_duration_s":0.002567,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000713,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001388,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031322,"duration_s":0.02341,"completed_at":"2026-08-16T17:30:16.042Z","load_balancing_strategy":"primary","db_duration_s":0.000639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 239.426803] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d3cebe22065af5c57792284a","created_at":"2026-08-16T17:30:13.997Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c9d2d80fc315dfa3ad9c618ce45fcf8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.047Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d3cebe22065af5c57792284a: start","job_status":"start","queue_duration_s":1.995826,"scheduling_latency_s":1.99584}1276gitlab # [ 239.441690] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d3cebe22065af5c57792284a","created_at":"2026-08-16T17:30:13.997Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c9d2d80fc315dfa3ad9c618ce45fcf8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.047Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d3cebe22065af5c57792284a: done: 0.020067 sec","job_status":"done","queue_duration_s":1.995826,"scheduling_latency_s":1.99584,"redis_calls":10,"redis_duration_s":0.002411,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001412,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003249,"duration_s":0.020067,"completed_at":"2026-08-16T17:30:16.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 239.484224] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e558973561518685f52dd1f","created_at":"2026-08-16T17:30:14.112Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.152Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e558973561518685f52dd1f: start","job_status":"start","queue_duration_s":1.912406,"scheduling_latency_s":1.912421}1278gitlab # [ 239.497771] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.174Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e558973561518685f52dd1f","created_at":"2026-08-16T17:30:14.112Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.152Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e558973561518685f52dd1f: done: 0.109894 sec","job_status":"done","queue_duration_s":1.912406,"scheduling_latency_s":1.912421,"redis_calls":71,"redis_duration_s":0.018399,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002401,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000931,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014338,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003332,"duration_s":0.109894,"completed_at":"2026-08-16T17:30:16.174Z","load_balancing_strategy":"primary","db_duration_s":0.002604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 239.541939] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.176Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f65a36c8787e2d0b91ceecf9","created_at":"2026-08-16T17:30:14.208Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13453a93a616009df36cb6367f76bfc1","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.256Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f65a36c8787e2d0b91ceecf9: start","job_status":"start","queue_duration_s":1.920164,"scheduling_latency_s":1.920179}1280gitlab # [ 239.555298] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.195Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"f65a36c8787e2d0b91ceecf9","created_at":"2026-08-16T17:30:14.208Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13453a93a616009df36cb6367f76bfc1","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.256Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-f65a36c8787e2d0b91ceecf9: done: 0.019278 sec","job_status":"done","queue_duration_s":1.920164,"scheduling_latency_s":1.920179,"redis_calls":12,"redis_duration_s":0.002906,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000579,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000489,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001353,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003133,"duration_s":0.019278,"completed_at":"2026-08-16T17:30:16.195Z","load_balancing_strategy":"primary","db_duration_s":0.000579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 239.599132] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"fd1825cf85fdff8586dae52b","created_at":"2026-08-16T17:30:14.312Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22ef114646a30c1c1788da6fe2adfec2","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.370Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-fd1825cf85fdff8586dae52b: start","job_status":"start","queue_duration_s":1.826397,"scheduling_latency_s":1.826412}1282gitlab # [ 239.612945] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"fd1825cf85fdff8586dae52b","created_at":"2026-08-16T17:30:14.312Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"22ef114646a30c1c1788da6fe2adfec2","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.370Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-fd1825cf85fdff8586dae52b: done: 0.058072 sec","job_status":"done","queue_duration_s":1.826397,"scheduling_latency_s":1.826412,"redis_calls":10,"redis_duration_s":0.002548,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043102,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.0039621},"duration_s":0.058072,"completed_at":"2026-08-16T17:30:16.255Z","load_balancing_strategy":"primary","db_duration_s":0.026425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 239.656359] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.256Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"325ab12fc6f764ecfc414697","created_at":"2026-08-16T17:30:14.406Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"165fd8288475a1bd59a32658f0d923ba","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.436Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-325ab12fc6f764ecfc414697: start","job_status":"start","queue_duration_s":1.820225,"scheduling_latency_s":1.820239}1284gitlab # [ 239.669649] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.277Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"325ab12fc6f764ecfc414697","created_at":"2026-08-16T17:30:14.406Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"165fd8288475a1bd59a32658f0d923ba","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.436Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-325ab12fc6f764ecfc414697: done: 0.020816 sec","job_status":"done","queue_duration_s":1.820225,"scheduling_latency_s":1.820239,"redis_calls":10,"redis_duration_s":0.0023250000000000002,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001376,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031876,"duration_s":0.020816,"completed_at":"2026-08-16T17:30:16.277Z","load_balancing_strategy":"primary","db_duration_s":0.00138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 239.711379] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"61ee1efc6a8893ace95577d6","created_at":"2026-08-16T17:30:14.462Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e5982150a2ef8b236cff90f63d41f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.485Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-61ee1efc6a8893ace95577d6: start","job_status":"start","queue_duration_s":1.793981,"scheduling_latency_s":1.793997}1286gitlab # [ 239.829862] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"61ee1efc6a8893ace95577d6","created_at":"2026-08-16T17:30:14.462Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0e5982150a2ef8b236cff90f63d41f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.485Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-61ee1efc6a8893ace95577d6: done: 0.362023 sec","job_status":"done","queue_duration_s":1.793981,"scheduling_latency_s":1.793997,"redis_calls":12,"redis_duration_s":0.017241,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002667,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008339,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.085,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.154889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.06505726,"exclusive_lock_hold_duration_s":0.11940049999999999,"duration_s":0.362023,"completed_at":"2026-08-16T17:30:16.641Z","load_balancing_strategy":"primary","db_duration_s":0.107401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 239.893445] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.648Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"cad4d366da79bcf4dfd3a4b1","created_at":"2026-08-16T17:30:14.529Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e57c4e4519840492cb102478e6bdaf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.555Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-cad4d366da79bcf4dfd3a4b1: start","job_status":"start","queue_duration_s":2.093015,"scheduling_latency_s":2.093061}1288gitlab # [ 239.909208] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"cad4d366da79bcf4dfd3a4b1","created_at":"2026-08-16T17:30:14.529Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e57c4e4519840492cb102478e6bdaf8","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.555Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-cad4d366da79bcf4dfd3a4b1: done: 0.066966 sec","job_status":"done","queue_duration_s":2.093015,"scheduling_latency_s":2.093061,"redis_calls":12,"redis_duration_s":0.006899,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001995,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001467,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061654,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.066966,"completed_at":"2026-08-16T17:30:16.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005498,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 239.958481] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"96b6287a827e82e7c003b5b1","created_at":"2026-08-16T17:30:14.588Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"858f01180851dc9a15c68ae5223796db","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.612Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-96b6287a827e82e7c003b5b1: start","job_status":"start","queue_duration_s":2.108537,"scheduling_latency_s":2.108577}1290gitlab # [ 239.995918] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"96b6287a827e82e7c003b5b1","created_at":"2026-08-16T17:30:14.588Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"858f01180851dc9a15c68ae5223796db","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.612Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-96b6287a827e82e7c003b5b1: done: 0.089396 sec","job_status":"done","queue_duration_s":2.108537,"scheduling_latency_s":2.108577,"redis_calls":12,"redis_duration_s":0.004216,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000598,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001671,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0011416,"exclusive_lock_hold_duration_s":0.02016914,"duration_s":0.089396,"completed_at":"2026-08-16T17:30:16.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 240.045950] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"225a3552d988dd5b8574b7f1","created_at":"2026-08-16T17:30:14.647Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abf571a38568d032de90491d77a2542f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.679Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-225a3552d988dd5b8574b7f1: start","job_status":"start","queue_duration_s":2.143054,"scheduling_latency_s":2.143096}1292gitlab # [ 240.165389] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"225a3552d988dd5b8574b7f1","created_at":"2026-08-16T17:30:14.647Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abf571a38568d032de90491d77a2542f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.679Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-225a3552d988dd5b8574b7f1: done: 0.155992 sec","job_status":"done","queue_duration_s":2.143054,"scheduling_latency_s":2.143096,"redis_calls":10,"redis_duration_s":0.012910999999999999,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00328184,"duration_s":0.155992,"completed_at":"2026-08-16T17:30:16.978Z","load_balancing_strategy":"primary","db_duration_s":0.032439,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 240.237776] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:16.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b91902e13624f0eabe30e5b3","created_at":"2026-08-16T17:30:14.700Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddb2ddb990e007f47458ef2e48328757","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.731Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b91902e13624f0eabe30e5b3: start","job_status":"start","queue_duration_s":2.262368,"scheduling_latency_s":2.262412}1294gitlab # [ 240.253992] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.034Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1295gitlab # [ 240.257831] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b91902e13624f0eabe30e5b3","created_at":"2026-08-16T17:30:14.700Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddb2ddb990e007f47458ef2e48328757","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.731Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b91902e13624f0eabe30e5b3: done: 0.066813 sec","job_status":"done","queue_duration_s":2.262368,"scheduling_latency_s":2.262412,"redis_calls":10,"redis_duration_s":0.0036040000000000004,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000715,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067098,"duration_s":0.066813,"completed_at":"2026-08-16T17:30:17.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004743,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 240.300429] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"04c6c42933fedb2e68de4659","created_at":"2026-08-16T17:30:14.783Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2897d12272ae59c89ea69f6629e47d37","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.814Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-04c6c42933fedb2e68de4659: start","job_status":"start","queue_duration_s":2.255202,"scheduling_latency_s":2.255242}1297gitlab # [ 240.314845] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.116Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1298gitlab # [ 240.351501] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"04c6c42933fedb2e68de4659","created_at":"2026-08-16T17:30:14.783Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2897d12272ae59c89ea69f6629e47d37","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.814Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-04c6c42933fedb2e68de4659: done: 0.095446 sec","job_status":"done","queue_duration_s":2.255202,"scheduling_latency_s":2.255242,"redis_calls":10,"redis_duration_s":0.006468,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003595,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063876,"duration_s":0.095446,"completed_at":"2026-08-16T17:30:17.165Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 240.417375] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"10039d2337d5c3aa6651188f","created_at":"2026-08-16T17:30:14.841Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61f606fdd4b8133643c2d27e5dfd9b21","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.867Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-10039d2337d5c3aa6651188f: start","job_status":"start","queue_duration_s":2.310924,"scheduling_latency_s":2.310964}1300gitlab # [ 240.479426] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"10039d2337d5c3aa6651188f","created_at":"2026-08-16T17:30:14.841Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61f606fdd4b8133643c2d27e5dfd9b21","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.867Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-10039d2337d5c3aa6651188f: done: 0.114636 sec","job_status":"done","queue_duration_s":2.310924,"scheduling_latency_s":2.310964,"redis_calls":10,"redis_duration_s":0.009889,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000697,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007391,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00358472,"duration_s":0.114636,"completed_at":"2026-08-16T17:30:17.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015971,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 240.558946] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.297Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"58360cd647ae40a53f591d0c","created_at":"2026-08-16T17:30:14.897Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2602315b1a595c372dff19a530a910a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.917Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-58360cd647ae40a53f591d0c: start","job_status":"start","queue_duration_s":2.380161,"scheduling_latency_s":2.380205}1302gitlab # [ 240.576606] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.378Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"58360cd647ae40a53f591d0c","created_at":"2026-08-16T17:30:14.897Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2602315b1a595c372dff19a530a910a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.917Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-58360cd647ae40a53f591d0c: done: 0.080717 sec","job_status":"done","queue_duration_s":2.380161,"scheduling_latency_s":2.380205,"redis_calls":11,"redis_duration_s":0.003397,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000625,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048514,"duration_s":0.080717,"completed_at":"2026-08-16T17:30:17.378Z","load_balancing_strategy":"primary","db_duration_s":0.008138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 240.623001] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f04c7dbc5a18dc668451c7d8","created_at":"2026-08-16T17:30:14.926Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"774d231f93b72a2fcc62fdc38a7eb043","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.940Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f04c7dbc5a18dc668451c7d8: start","job_status":"start","queue_duration_s":2.446421,"scheduling_latency_s":2.446462}1304gitlab # [ 240.828206] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f04c7dbc5a18dc668451c7d8","created_at":"2026-08-16T17:30:14.926Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"774d231f93b72a2fcc62fdc38a7eb043","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.940Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f04c7dbc5a18dc668451c7d8: done: 0.251789 sec","job_status":"done","queue_duration_s":2.446421,"scheduling_latency_s":2.446462,"redis_calls":14,"redis_duration_s":0.018157,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004336,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008592,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.072,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.062,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00143672,"exclusive_lock_hold_duration_s":0.15399546,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.251789,"completed_at":"2026-08-16T17:30:17.638Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.139331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 240.912791] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"d0332f6a4d9e02690ec609fc","created_at":"2026-08-16T17:30:14.972Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.992Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-d0332f6a4d9e02690ec609fc: start","job_status":"start","queue_duration_s":2.665029,"scheduling_latency_s":2.665074}1306gitlab # [ 241.086254] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.899Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"d0332f6a4d9e02690ec609fc","created_at":"2026-08-16T17:30:14.972Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:14.992Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-d0332f6a4d9e02690ec609fc: done: 0.242341 sec","job_status":"done","queue_duration_s":2.665029,"scheduling_latency_s":2.665074,"redis_calls":24,"redis_duration_s":0.060155,"redis_read_bytes":25,"redis_write_bytes":5977,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004952,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.003344,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3810,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.030129,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.02173,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00388798,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.242341,"completed_at":"2026-08-16T17:30:17.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 241.195254] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6aa98703ae1648b050a0a759","created_at":"2026-08-16T17:30:15.015Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c21eaefa076b13c51c2ee1d575c5cf48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.026Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6aa98703ae1648b050a0a759: start","job_status":"start","queue_duration_s":2.887141,"scheduling_latency_s":2.88719}1308gitlab # [ 241.217488] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:17.970Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1309gitlab # [ 241.222594] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6aa98703ae1648b050a0a759","created_at":"2026-08-16T17:30:15.015Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c21eaefa076b13c51c2ee1d575c5cf48","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.026Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6aa98703ae1648b050a0a759: done: 0.113298 sec","job_status":"done","queue_duration_s":2.887141,"scheduling_latency_s":2.88719,"redis_calls":10,"redis_duration_s":0.032355,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006821,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00685,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00227618,"duration_s":0.113298,"completed_at":"2026-08-16T17:30:18.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 241.268225] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.040Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c5e615514cb82c3c2b366ad9","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c5e615514cb82c3c2b366ad9: start","job_status":"start","queue_duration_s":2.846469,"scheduling_latency_s":2.846511}1311gitlab # [ 241.327179] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.141Z","message":"No existing merge request to be cleaned up."}1312gitlab # [ 241.683162] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.496Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c5e615514cb82c3c2b366ad9","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c5e615514cb82c3c2b366ad9: done: 0.456371 sec","job_status":"done","queue_duration_s":2.846469,"scheduling_latency_s":2.846511,"redis_calls":13,"redis_duration_s":0.033251,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00695,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.012603,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00193398,"duration_s":0.456371,"completed_at":"2026-08-16T17:30:18.496Z","load_balancing_strategy":"primary","db_duration_s":0.036631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 241.783985] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.598Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dd250e2741ef2ac72fe6083c","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dd250e2741ef2ac72fe6083c: start","job_status":"start","queue_duration_s":3.40452,"scheduling_latency_s":3.404551}1314gitlab # [ 241.894631] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.709Z","message":"No existing merge request to be cleaned up."}1315gitlab # [ 241.948343] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.761Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dd250e2741ef2ac72fe6083c","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dd250e2741ef2ac72fe6083c: done: 0.163244 sec","job_status":"done","queue_duration_s":3.40452,"scheduling_latency_s":3.404551,"redis_calls":10,"redis_duration_s":0.017661,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.010059,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.163244,"completed_at":"2026-08-16T17:30:18.761Z","load_balancing_strategy":"primary","db_duration_s":0.014649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 242.036573] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.777Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5bde99be3d23bde7ae2fc781","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5bde99be3d23bde7ae2fc781: start","job_status":"start","queue_duration_s":3.58341,"scheduling_latency_s":3.583474}1317gitlab # [ 242.053149] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.848Z","message":"No existing merge request to be cleaned up."}1318gitlab # [ 242.085580] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.899Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5bde99be3d23bde7ae2fc781","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5bde99be3d23bde7ae2fc781: done: 0.12201 sec","job_status":"done","queue_duration_s":3.58341,"scheduling_latency_s":3.583474,"redis_calls":10,"redis_duration_s":0.030975999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.011949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.019027,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.009,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.12201,"completed_at":"2026-08-16T17:30:18.899Z","load_balancing_strategy":"primary","db_duration_s":0.021807,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 242.154824] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.913Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"96e48c40507618324bceb95e","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-96e48c40507618324bceb95e: start","job_status":"start","queue_duration_s":3.719288,"scheduling_latency_s":3.719331}1320gitlab # [ 242.169867] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:18.984Z","message":"No existing merge request to be cleaned up."}1321gitlab # [ 242.222625] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.035Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"96e48c40507618324bceb95e","created_at":"2026-08-16T17:30:15.181Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-76260a26d09a47a9","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"c9b30a17aa11c240021621e8d1e77f8a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.193Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-96e48c40507618324bceb95e: done: 0.122136 sec","job_status":"done","queue_duration_s":3.719288,"scheduling_latency_s":3.719331,"redis_calls":10,"redis_duration_s":0.02994,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.01065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.01929,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.122136,"completed_at":"2026-08-16T17:30:19.035Z","load_balancing_strategy":"primary","db_duration_s":0.026935,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 242.300888] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.050Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"66f51994114325aab74d16e3","created_at":"2026-08-16T17:30:15.438Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-74cb4a2fc5bb4602","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ad28030bdf4c4e8e93ea245b5d0e3b68","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.457Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-66f51994114325aab74d16e3: start","job_status":"start","queue_duration_s":3.59215,"scheduling_latency_s":3.592195}1323gitlab # [ 242.403806] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.217Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"66f51994114325aab74d16e3","created_at":"2026-08-16T17:30:15.438Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-74cb4a2fc5bb4602","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ad28030bdf4c4e8e93ea245b5d0e3b68","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.457Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-66f51994114325aab74d16e3: done: 0.167432 sec","job_status":"done","queue_duration_s":3.59215,"scheduling_latency_s":3.592195,"redis_calls":10,"redis_duration_s":0.013049,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000857,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0019551,"duration_s":0.167432,"completed_at":"2026-08-16T17:30:19.217Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 242.495637] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.224Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"17895e06b88878c574b1b57d","created_at":"2026-08-16T17:30:15.459Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-74cb4a2fc5bb4602","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ad28030bdf4c4e8e93ea245b5d0e3b68","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.466Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-17895e06b88878c574b1b57d: start","job_status":"start","queue_duration_s":3.757177,"scheduling_latency_s":3.757218}1325gitlab # [ 242.513850] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.301Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"17895e06b88878c574b1b57d","created_at":"2026-08-16T17:30:15.459Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-74cb4a2fc5bb4602","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"ad28030bdf4c4e8e93ea245b5d0e3b68","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-16T17:30:15.466Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-17895e06b88878c574b1b57d: done: 0.077087 sec","job_status":"done","queue_duration_s":3.757177,"scheduling_latency_s":3.757218,"redis_calls":10,"redis_duration_s":0.003458,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000704,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00203,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006391,"duration_s":0.077087,"completed_at":"2026-08-16T17:30:19.300Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 242.557464] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92d5de5e900efd941ec4770b","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92d5de5e900efd941ec4770b: start","job_status":"start","queue_duration_s":3.138356,"scheduling_latency_s":3.138391}1327gitlab # [ 242.569959] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92d5de5e900efd941ec4770b","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92d5de5e900efd941ec4770b: done: 0.074058 sec","job_status":"done","queue_duration_s":3.138356,"scheduling_latency_s":3.138391,"redis_calls":16,"redis_duration_s":0.005638,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000783,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003361,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058462,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.074058,"completed_at":"2026-08-16T17:30:19.377Z","load_balancing_strategy":"primary","db_duration_s":0.004011,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 242.611868] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"407b0389fea7cccdb9e25cbc","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-407b0389fea7cccdb9e25cbc: start","job_status":"start","queue_duration_s":3.21511,"scheduling_latency_s":3.215145}1329gitlab # [ 242.627551] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"407b0389fea7cccdb9e25cbc","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-407b0389fea7cccdb9e25cbc: done: 0.060759 sec","job_status":"done","queue_duration_s":3.21511,"scheduling_latency_s":3.215145,"redis_calls":13,"redis_duration_s":0.00379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002492,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060759,"completed_at":"2026-08-16T17:30:19.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 242.668446] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a2bc167e450184c66d35bcb","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a2bc167e450184c66d35bcb: start","job_status":"start","queue_duration_s":3.278829,"scheduling_latency_s":3.278867}1331gitlab # [ 242.702553] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a2bc167e450184c66d35bcb","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a2bc167e450184c66d35bcb: done: 0.072001 sec","job_status":"done","queue_duration_s":3.278829,"scheduling_latency_s":3.278867,"redis_calls":13,"redis_duration_s":0.005455,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00286,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002595,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.072001,"completed_at":"2026-08-16T17:30:19.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 242.745420] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf53f2b098d7b7df4c111519","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf53f2b098d7b7df4c111519: start","job_status":"start","queue_duration_s":3.35917,"scheduling_latency_s":3.359213}1333gitlab # [ 242.808000] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf53f2b098d7b7df4c111519","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf53f2b098d7b7df4c111519: done: 0.097073 sec","job_status":"done","queue_duration_s":3.35917,"scheduling_latency_s":3.359213,"redis_calls":13,"redis_duration_s":0.035989,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.009227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.026762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.097073,"completed_at":"2026-08-16T17:30:19.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 242.871753] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"607ac0a09b22a12fd35c92ec","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-607ac0a09b22a12fd35c92ec: start","job_status":"start","queue_duration_s":3.470047,"scheduling_latency_s":3.470088}1335gitlab # [ 242.904867] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"607ac0a09b22a12fd35c92ec","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-607ac0a09b22a12fd35c92ec: done: 0.08327 sec","job_status":"done","queue_duration_s":3.470047,"scheduling_latency_s":3.470088,"redis_calls":13,"redis_duration_s":0.022648,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.019799,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002849,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.08327,"completed_at":"2026-08-16T17:30:19.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 242.980081] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af201ee5faf908e8330e453f","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af201ee5faf908e8330e453f: start","job_status":"start","queue_duration_s":3.55711,"scheduling_latency_s":3.557149}1337gitlab # [ 242.994680] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af201ee5faf908e8330e453f","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af201ee5faf908e8330e453f: done: 0.04458 sec","job_status":"done","queue_duration_s":3.55711,"scheduling_latency_s":3.557149,"redis_calls":13,"redis_duration_s":0.003405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04458,"completed_at":"2026-08-16T17:30:19.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 243.037078] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f253120693b92ce3b0e07726","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f253120693b92ce3b0e07726: start","job_status":"start","queue_duration_s":3.606382,"scheduling_latency_s":3.606415}1339gitlab # [ 243.050137] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f253120693b92ce3b0e07726","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f253120693b92ce3b0e07726: done: 0.060121 sec","job_status":"done","queue_duration_s":3.606382,"scheduling_latency_s":3.606415,"redis_calls":13,"redis_duration_s":0.003536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002284,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060121,"completed_at":"2026-08-16T17:30:19.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 243.089393] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fea7ea547e4e4e09fe49283f","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fea7ea547e4e4e09fe49283f: start","job_status":"start","queue_duration_s":3.669485,"scheduling_latency_s":3.669524}1341gitlab # [ 243.101629] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fea7ea547e4e4e09fe49283f","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fea7ea547e4e4e09fe49283f: done: 0.065237 sec","job_status":"done","queue_duration_s":3.669485,"scheduling_latency_s":3.669524,"redis_calls":13,"redis_duration_s":0.006980999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005567,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.065237,"completed_at":"2026-08-16T17:30:19.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 243.140454] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"698f02ecd1e30271f1309c7f","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-698f02ecd1e30271f1309c7f: start","job_status":"start","queue_duration_s":3.737598,"scheduling_latency_s":3.737635}1343gitlab # [ 243.158954] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"698f02ecd1e30271f1309c7f","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-698f02ecd1e30271f1309c7f: done: 0.069496 sec","job_status":"done","queue_duration_s":3.737598,"scheduling_latency_s":3.737635,"redis_calls":13,"redis_duration_s":0.007778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003734,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.069496,"completed_at":"2026-08-16T17:30:19.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 243.199015] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:19.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f77283ab22a08b1c243f6815","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f77283ab22a08b1c243f6815: start","job_status":"start","queue_duration_s":3.81036,"scheduling_latency_s":3.810398}1345gitlab # [ 243.220829] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f77283ab22a08b1c243f6815","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f77283ab22a08b1c243f6815: done: 0.058421 sec","job_status":"done","queue_duration_s":3.81036,"scheduling_latency_s":3.810398,"redis_calls":13,"redis_duration_s":0.004011,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002604,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.058421,"completed_at":"2026-08-16T17:30:20.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 243.261655] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b346df465dda6b8b8bde0a8e","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b346df465dda6b8b8bde0a8e: start","job_status":"start","queue_duration_s":3.87435,"scheduling_latency_s":3.874402}1347gitlab # [ 243.285498] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b346df465dda6b8b8bde0a8e","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b346df465dda6b8b8bde0a8e: done: 0.05914 sec","job_status":"done","queue_duration_s":3.87435,"scheduling_latency_s":3.874402,"redis_calls":13,"redis_duration_s":0.004118999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002705,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05914,"completed_at":"2026-08-16T17:30:20.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 243.369353] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"525147df820b538fc2c9b7bd","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-525147df820b538fc2c9b7bd: start","job_status":"start","queue_duration_s":3.937858,"scheduling_latency_s":3.937898}1349gitlab # [ 243.384878] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"525147df820b538fc2c9b7bd","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-525147df820b538fc2c9b7bd: done: 0.048168 sec","job_status":"done","queue_duration_s":3.937858,"scheduling_latency_s":3.937898,"redis_calls":13,"redis_duration_s":0.0038919999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002554,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048168,"completed_at":"2026-08-16T17:30:20.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 243.425209] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7009c1b3323287a17f54b7a","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7009c1b3323287a17f54b7a: start","job_status":"start","queue_duration_s":3.991262,"scheduling_latency_s":3.991302}1351gitlab # [ 243.438732] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7009c1b3323287a17f54b7a","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7009c1b3323287a17f54b7a: done: 0.054191 sec","job_status":"done","queue_duration_s":3.991262,"scheduling_latency_s":3.991302,"redis_calls":13,"redis_duration_s":0.003698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001251,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002447,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054191,"completed_at":"2026-08-16T17:30:20.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 243.478090] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42c4e0317362801710bea6e","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42c4e0317362801710bea6e: start","job_status":"start","queue_duration_s":4.051444,"scheduling_latency_s":4.051482}1353gitlab # [ 243.509263] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42c4e0317362801710bea6e","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42c4e0317362801710bea6e: done: 0.069482 sec","job_status":"done","queue_duration_s":4.051444,"scheduling_latency_s":4.051482,"redis_calls":13,"redis_duration_s":0.004452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.069482,"completed_at":"2026-08-16T17:30:20.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 243.564056] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5172b6e82f38c0a4d2a559a5","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5172b6e82f38c0a4d2a559a5: start","job_status":"start","queue_duration_s":4.125847,"scheduling_latency_s":4.125894}1355gitlab # [ 243.577506] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5172b6e82f38c0a4d2a559a5","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5172b6e82f38c0a4d2a559a5: done: 0.066452 sec","job_status":"done","queue_duration_s":4.125847,"scheduling_latency_s":4.125894,"redis_calls":13,"redis_duration_s":0.004361,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002827,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.066452,"completed_at":"2026-08-16T17:30:20.357Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 243.616760] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b617857673db87a649f565d3","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b617857673db87a649f565d3: start","job_status":"start","queue_duration_s":4.201842,"scheduling_latency_s":4.201894}1357gitlab # [ 243.641169] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b617857673db87a649f565d3","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b617857673db87a649f565d3: done: 0.087989 sec","job_status":"done","queue_duration_s":4.201842,"scheduling_latency_s":4.201894,"redis_calls":13,"redis_duration_s":0.031698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.022808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.087989,"completed_at":"2026-08-16T17:30:20.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 243.738410] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"360cb0d092b30af5fc27f81c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-360cb0d092b30af5fc27f81c: start","job_status":"start","queue_duration_s":4.386047,"scheduling_latency_s":4.386089}1359gitlab # [ 243.868370] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"360cb0d092b30af5fc27f81c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-360cb0d092b30af5fc27f81c: done: 0.130548 sec","job_status":"done","queue_duration_s":4.386047,"scheduling_latency_s":4.386089,"redis_calls":13,"redis_duration_s":0.023589,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006137,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017452,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.130548,"completed_at":"2026-08-16T17:30:20.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 243.966878] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe67ea3c8148a8b5f6a26dcc","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe67ea3c8148a8b5f6a26dcc: start","job_status":"start","queue_duration_s":4.528347,"scheduling_latency_s":4.52839}1361gitlab # [ 244.042745] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe67ea3c8148a8b5f6a26dcc","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe67ea3c8148a8b5f6a26dcc: done: 0.163248 sec","job_status":"done","queue_duration_s":4.528347,"scheduling_latency_s":4.52839,"redis_calls":13,"redis_duration_s":0.012138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001675,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010463,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.163248,"completed_at":"2026-08-16T17:30:20.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 244.123908] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:20.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e7170de0784ec5bff14b9d4","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e7170de0784ec5bff14b9d4: start","job_status":"start","queue_duration_s":4.696005,"scheduling_latency_s":4.696055}1363gitlab # [ 244.248073] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e7170de0784ec5bff14b9d4","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e7170de0784ec5bff14b9d4: done: 0.200124 sec","job_status":"done","queue_duration_s":4.696005,"scheduling_latency_s":4.696055,"redis_calls":13,"redis_duration_s":0.029622000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008238,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.021384,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.200124,"completed_at":"2026-08-16T17:30:21.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 244.335873] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77796f6db500c3469f01d46a","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77796f6db500c3469f01d46a: start","job_status":"start","queue_duration_s":4.903189,"scheduling_latency_s":4.90324}1365gitlab # [ 244.351952] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77796f6db500c3469f01d46a","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77796f6db500c3469f01d46a: done: 0.067439 sec","job_status":"done","queue_duration_s":4.903189,"scheduling_latency_s":4.90324,"redis_calls":13,"redis_duration_s":0.00432,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.067439,"completed_at":"2026-08-16T17:30:21.136Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 244.393226] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdcddd271aa23fec7bd3905c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdcddd271aa23fec7bd3905c: start","job_status":"start","queue_duration_s":4.973548,"scheduling_latency_s":4.973586}1367gitlab # [ 244.405678] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdcddd271aa23fec7bd3905c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdcddd271aa23fec7bd3905c: done: 0.067784 sec","job_status":"done","queue_duration_s":4.973548,"scheduling_latency_s":4.973586,"redis_calls":13,"redis_duration_s":0.004194,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.067784,"completed_at":"2026-08-16T17:30:21.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 244.445004] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588e0abb8091d89b40f8c0f7","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588e0abb8091d89b40f8c0f7: start","job_status":"start","queue_duration_s":5.045363,"scheduling_latency_s":5.045403}1369gitlab # [ 244.467254] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588e0abb8091d89b40f8c0f7","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588e0abb8091d89b40f8c0f7: done: 0.070282 sec","job_status":"done","queue_duration_s":5.045363,"scheduling_latency_s":5.045403,"redis_calls":13,"redis_duration_s":0.003908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002524,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.070282,"completed_at":"2026-08-16T17:30:21.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 244.513515] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70fd3caa519659e931f8686c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70fd3caa519659e931f8686c: start","job_status":"start","queue_duration_s":5.118583,"scheduling_latency_s":5.11862}1371gitlab # [ 244.535280] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70fd3caa519659e931f8686c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70fd3caa519659e931f8686c: done: 0.065691 sec","job_status":"done","queue_duration_s":5.118583,"scheduling_latency_s":5.11862,"redis_calls":13,"redis_duration_s":0.003888,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002564,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.065691,"completed_at":"2026-08-16T17:30:21.349Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 244.578290] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef64f933c2a15f25e57ee017","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef64f933c2a15f25e57ee017: start","job_status":"start","queue_duration_s":5.194463,"scheduling_latency_s":5.194503}1373gitlab # [ 244.674853] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef64f933c2a15f25e57ee017","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef64f933c2a15f25e57ee017: done: 0.128648 sec","job_status":"done","queue_duration_s":5.194463,"scheduling_latency_s":5.194503,"redis_calls":13,"redis_duration_s":0.024848,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.016339,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.128648,"completed_at":"2026-08-16T17:30:21.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 244.739597] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"192bba5e0043ac08364f71f2","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-192bba5e0043ac08364f71f2: start","job_status":"start","queue_duration_s":5.328272,"scheduling_latency_s":5.328312}1375gitlab # [ 244.753805] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"192bba5e0043ac08364f71f2","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-192bba5e0043ac08364f71f2: done: 0.064148 sec","job_status":"done","queue_duration_s":5.328272,"scheduling_latency_s":5.328312,"redis_calls":13,"redis_duration_s":0.004275,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002816,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064148,"completed_at":"2026-08-16T17:30:21.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 244.793693] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e4286accf017a329930e5fd","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e4286accf017a329930e5fd: start","job_status":"start","queue_duration_s":5.398556,"scheduling_latency_s":5.398596}1377gitlab # [ 244.828657] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e4286accf017a329930e5fd","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e4286accf017a329930e5fd: done: 0.078753 sec","job_status":"done","queue_duration_s":5.398556,"scheduling_latency_s":5.398596,"redis_calls":13,"redis_duration_s":0.010797000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006665,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.078753,"completed_at":"2026-08-16T17:30:21.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 244.913540] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db997722da3c8532b1e559a9","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db997722da3c8532b1e559a9: start","job_status":"start","queue_duration_s":5.481089,"scheduling_latency_s":5.481113}1379gitlab # [ 244.930118] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db997722da3c8532b1e559a9","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db997722da3c8532b1e559a9: done: 0.062181 sec","job_status":"done","queue_duration_s":5.481089,"scheduling_latency_s":5.481113,"redis_calls":13,"redis_duration_s":0.007462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.062181,"completed_at":"2026-08-16T17:30:21.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 244.977933] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c62da54a3f3734228d99c35c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c62da54a3f3734228d99c35c: start","job_status":"start","queue_duration_s":5.550755,"scheduling_latency_s":5.550791}1381gitlab # [ 244.992273] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c62da54a3f3734228d99c35c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c62da54a3f3734228d99c35c: done: 0.055738 sec","job_status":"done","queue_duration_s":5.550755,"scheduling_latency_s":5.550791,"redis_calls":13,"redis_duration_s":0.0036430000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002393,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.055738,"completed_at":"2026-08-16T17:30:21.771Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 245.032465] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99d5eb96b1c8a8ca41f66870","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99d5eb96b1c8a8ca41f66870: start","job_status":"start","queue_duration_s":5.66499,"scheduling_latency_s":5.665021}1383gitlab # [ 245.123520] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99d5eb96b1c8a8ca41f66870","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99d5eb96b1c8a8ca41f66870: done: 0.107007 sec","job_status":"done","queue_duration_s":5.66499,"scheduling_latency_s":5.665021,"redis_calls":13,"redis_duration_s":0.023611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006378,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.107007,"completed_at":"2026-08-16T17:30:21.937Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 245.209199] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e15580ba86f2b8695a3b3388","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e15580ba86f2b8695a3b3388: start","job_status":"start","queue_duration_s":5.77481,"scheduling_latency_s":5.774844}1385gitlab # [ 245.224897] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:21.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e15580ba86f2b8695a3b3388","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e15580ba86f2b8695a3b3388: done: 0.054519 sec","job_status":"done","queue_duration_s":5.77481,"scheduling_latency_s":5.774844,"redis_calls":13,"redis_duration_s":0.0028,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.054519,"completed_at":"2026-08-16T17:30:21.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 245.265872] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"589121eaca72982d1908dacd","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-589121eaca72982d1908dacd: start","job_status":"start","queue_duration_s":5.834459,"scheduling_latency_s":5.834491}1387gitlab # [ 245.278148] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"589121eaca72982d1908dacd","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-589121eaca72982d1908dacd: done: 0.06576 sec","job_status":"done","queue_duration_s":5.834459,"scheduling_latency_s":5.834491,"redis_calls":13,"redis_duration_s":0.0033280000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001193,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.06576,"completed_at":"2026-08-16T17:30:22.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 245.318660] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6179efeef69f04c96d0e2ee6","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6179efeef69f04c96d0e2ee6: start","job_status":"start","queue_duration_s":5.904167,"scheduling_latency_s":5.904204}1389gitlab # [ 245.331312] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6179efeef69f04c96d0e2ee6","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6179efeef69f04c96d0e2ee6: done: 0.065139 sec","job_status":"done","queue_duration_s":5.904167,"scheduling_latency_s":5.904204,"redis_calls":13,"redis_duration_s":0.007128000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.065139,"completed_at":"2026-08-16T17:30:22.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 245.371351] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98de70bb21f2e95427754ea7","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98de70bb21f2e95427754ea7: start","job_status":"start","queue_duration_s":5.973741,"scheduling_latency_s":5.973793}1391gitlab # [ 245.406380] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98de70bb21f2e95427754ea7","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98de70bb21f2e95427754ea7: done: 0.080949 sec","job_status":"done","queue_duration_s":5.973741,"scheduling_latency_s":5.973793,"redis_calls":13,"redis_duration_s":0.008482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.080949,"completed_at":"2026-08-16T17:30:22.220Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 245.447769] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bab4f77f5c7db8ff1102f32","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bab4f77f5c7db8ff1102f32: start","job_status":"start","queue_duration_s":6.058996,"scheduling_latency_s":6.059035}1393gitlab # [ 245.489189] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bab4f77f5c7db8ff1102f32","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bab4f77f5c7db8ff1102f32: done: 0.078325 sec","job_status":"done","queue_duration_s":6.058996,"scheduling_latency_s":6.059035,"redis_calls":13,"redis_duration_s":0.0042179999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.078325,"completed_at":"2026-08-16T17:30:22.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 245.536283] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b782b415fdd2fc9b4a0a5fc","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b782b415fdd2fc9b4a0a5fc: start","job_status":"start","queue_duration_s":6.143251,"scheduling_latency_s":6.14329}1395gitlab # [ 245.556459] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b782b415fdd2fc9b4a0a5fc","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b782b415fdd2fc9b4a0a5fc: done: 0.061382 sec","job_status":"done","queue_duration_s":6.143251,"scheduling_latency_s":6.14329,"redis_calls":13,"redis_duration_s":0.004361,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.061382,"completed_at":"2026-08-16T17:30:22.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 245.596767] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7caa1506e8e661b87ac4d0c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7caa1506e8e661b87ac4d0c: start","job_status":"start","queue_duration_s":6.20924,"scheduling_latency_s":6.209279}1397gitlab # [ 245.618183] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7caa1506e8e661b87ac4d0c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7caa1506e8e661b87ac4d0c: done: 0.057304 sec","job_status":"done","queue_duration_s":6.20924,"scheduling_latency_s":6.209279,"redis_calls":13,"redis_duration_s":0.004158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001386,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.057304,"completed_at":"2026-08-16T17:30:22.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 245.657690] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27843bcc59a620401396ab87","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27843bcc59a620401396ab87: start","job_status":"start","queue_duration_s":6.269625,"scheduling_latency_s":6.269663}1399gitlab # [ 245.681310] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27843bcc59a620401396ab87","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27843bcc59a620401396ab87: done: 0.060003 sec","job_status":"done","queue_duration_s":6.269625,"scheduling_latency_s":6.269663,"redis_calls":13,"redis_duration_s":0.0039059999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002565,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060003,"completed_at":"2026-08-16T17:30:22.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 245.721656] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31199353a7211f50bec299d7","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31199353a7211f50bec299d7: start","job_status":"start","queue_duration_s":6.332706,"scheduling_latency_s":6.332757}1401gitlab # [ 245.734201] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31199353a7211f50bec299d7","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31199353a7211f50bec299d7: done: 0.030969 sec","job_status":"done","queue_duration_s":6.332706,"scheduling_latency_s":6.332757,"redis_calls":13,"redis_duration_s":0.002987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001071,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030969,"completed_at":"2026-08-16T17:30:22.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 245.773485] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cfac93c15519d84b886c672","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cfac93c15519d84b886c672: start","job_status":"start","queue_duration_s":6.365333,"scheduling_latency_s":6.365357}1403gitlab # [ 245.786060] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cfac93c15519d84b886c672","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cfac93c15519d84b886c672: done: 0.021082 sec","job_status":"done","queue_duration_s":6.365333,"scheduling_latency_s":6.365357,"redis_calls":13,"redis_duration_s":0.0022040000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001426,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021082,"completed_at":"2026-08-16T17:30:22.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 245.825533] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68e948edc89902cd8be4a151","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68e948edc89902cd8be4a151: start","job_status":"start","queue_duration_s":6.388325,"scheduling_latency_s":6.388345}1405gitlab # [ 245.837855] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68e948edc89902cd8be4a151","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68e948edc89902cd8be4a151: done: 0.017796 sec","job_status":"done","queue_duration_s":6.388325,"scheduling_latency_s":6.388345,"redis_calls":13,"redis_duration_s":0.001898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000776,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017796,"completed_at":"2026-08-16T17:30:22.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 245.877315] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5425543289f9823d75bf8cf1","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5425543289f9823d75bf8cf1: start","job_status":"start","queue_duration_s":6.407347,"scheduling_latency_s":6.407364}1407gitlab # [ 245.890944] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5425543289f9823d75bf8cf1","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5425543289f9823d75bf8cf1: done: 0.015303 sec","job_status":"done","queue_duration_s":6.407347,"scheduling_latency_s":6.407364,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015303,"completed_at":"2026-08-16T17:30:22.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 245.930806] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00e084c93a8c272cdfacfcf3","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00e084c93a8c272cdfacfcf3: start","job_status":"start","queue_duration_s":6.424071,"scheduling_latency_s":6.424087}1409gitlab # [ 245.943186] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00e084c93a8c272cdfacfcf3","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00e084c93a8c272cdfacfcf3: done: 0.014136 sec","job_status":"done","queue_duration_s":6.424071,"scheduling_latency_s":6.424087,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014136,"completed_at":"2026-08-16T17:30:22.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 245.983230] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdb128c5a8ca6cd6d0fa5f5d","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdb128c5a8ca6cd6d0fa5f5d: start","job_status":"start","queue_duration_s":6.43961,"scheduling_latency_s":6.439626}1411gitlab # [ 245.995634] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdb128c5a8ca6cd6d0fa5f5d","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdb128c5a8ca6cd6d0fa5f5d: done: 0.013959 sec","job_status":"done","queue_duration_s":6.43961,"scheduling_latency_s":6.439626,"redis_calls":13,"redis_duration_s":0.0014360000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013959,"completed_at":"2026-08-16T17:30:22.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 246.035799] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe75cab386a56ddf13ae3ae","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe75cab386a56ddf13ae3ae: start","job_status":"start","queue_duration_s":6.454628,"scheduling_latency_s":6.454643}1413gitlab # [ 246.048694] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fe75cab386a56ddf13ae3ae","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fe75cab386a56ddf13ae3ae: done: 0.014178 sec","job_status":"done","queue_duration_s":6.454628,"scheduling_latency_s":6.454643,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014178,"completed_at":"2026-08-16T17:30:22.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 246.088333] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc11403b220ac042120d8919","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc11403b220ac042120d8919: start","job_status":"start","queue_duration_s":6.46998,"scheduling_latency_s":6.469996}1415gitlab # [ 246.101628] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc11403b220ac042120d8919","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc11403b220ac042120d8919: done: 0.013938 sec","job_status":"done","queue_duration_s":6.46998,"scheduling_latency_s":6.469996,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013938,"completed_at":"2026-08-16T17:30:22.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 246.140678] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3ab712d3c424a0317a3ab53","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3ab712d3c424a0317a3ab53: start","job_status":"start","queue_duration_s":6.485211,"scheduling_latency_s":6.485226}1417gitlab # [ 246.153091] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3ab712d3c424a0317a3ab53","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3ab712d3c424a0317a3ab53: done: 0.01372 sec","job_status":"done","queue_duration_s":6.485211,"scheduling_latency_s":6.485226,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01372,"completed_at":"2026-08-16T17:30:22.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 246.192579] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04d74ae90162f0d7e86412a5","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04d74ae90162f0d7e86412a5: start","job_status":"start","queue_duration_s":6.500002,"scheduling_latency_s":6.500017}1419gitlab # [ 246.204925] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04d74ae90162f0d7e86412a5","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04d74ae90162f0d7e86412a5: done: 0.014101 sec","job_status":"done","queue_duration_s":6.500002,"scheduling_latency_s":6.500017,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014101,"completed_at":"2026-08-16T17:30:22.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 246.243583] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f93513c00e0a05d450e577d2","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f93513c00e0a05d450e577d2: start","job_status":"start","queue_duration_s":6.515149,"scheduling_latency_s":6.515165}1421gitlab # [ 246.256125] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f93513c00e0a05d450e577d2","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f93513c00e0a05d450e577d2: done: 0.013993 sec","job_status":"done","queue_duration_s":6.515149,"scheduling_latency_s":6.515165,"redis_calls":13,"redis_duration_s":0.0015890000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001069,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013993,"completed_at":"2026-08-16T17:30:22.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 246.294986] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20ab931292df3bcfc6465cce","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20ab931292df3bcfc6465cce: start","job_status":"start","queue_duration_s":6.530429,"scheduling_latency_s":6.530444}1423gitlab # [ 246.308131] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20ab931292df3bcfc6465cce","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20ab931292df3bcfc6465cce: done: 0.013955 sec","job_status":"done","queue_duration_s":6.530429,"scheduling_latency_s":6.530444,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013955,"completed_at":"2026-08-16T17:30:22.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 246.348157] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01387bba8e26b2a7ab5e079c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01387bba8e26b2a7ab5e079c: start","job_status":"start","queue_duration_s":6.54544,"scheduling_latency_s":6.545456}1425gitlab # [ 246.360723] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01387bba8e26b2a7ab5e079c","created_at":"2026-08-16T17:30:16.085Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-5b70f27f82c1435d","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"41522bc506dd67ada97436bcbc56a096","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:16.165Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01387bba8e26b2a7ab5e079c: done: 0.013944 sec","job_status":"done","queue_duration_s":6.54544,"scheduling_latency_s":6.545456,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013944,"completed_at":"2026-08-16T17:30:22.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 246.400751] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"7e0011a537b0549244c893f9","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-7e0011a537b0549244c893f9: start","job_status":"start","queue_duration_s":4.875146,"scheduling_latency_s":4.875161}1427gitlab # [ 246.413195] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"7e0011a537b0549244c893f9","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-7e0011a537b0549244c893f9: done: 0.048961 sec","job_status":"done","queue_duration_s":4.875146,"scheduling_latency_s":4.875161,"redis_calls":18,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":39,"redis_write_bytes":2116,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":471,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":34,"redis_shared_state_write_bytes":1324,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025378,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":2,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":2,"duration_s":0.048961,"completed_at":"2026-08-16T17:30:22.774Z","load_balancing_strategy":"primary","db_duration_s":0.018589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 246.456734] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"2edc193affe21e9a4ece1617","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-2edc193affe21e9a4ece1617: start","job_status":"start","queue_duration_s":4.925236,"scheduling_latency_s":4.925251}1429gitlab # [ 246.469292] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"2edc193affe21e9a4ece1617","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-2edc193affe21e9a4ece1617: done: 0.022962 sec","job_status":"done","queue_duration_s":4.925236,"scheduling_latency_s":4.925251,"redis_calls":15,"redis_duration_s":0.0017529999999999998,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001179,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":2,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":2,"duration_s":0.022962,"completed_at":"2026-08-16T17:30:22.799Z","load_balancing_strategy":"primary","db_duration_s":0.00407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 246.512152] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"3c45f61b3f548b931d2995bb","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-3c45f61b3f548b931d2995bb: start","job_status":"start","queue_duration_s":4.949278,"scheduling_latency_s":4.949295}1431gitlab # [ 246.524331] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"3c45f61b3f548b931d2995bb","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-3c45f61b3f548b931d2995bb: done: 0.02268 sec","job_status":"done","queue_duration_s":4.949278,"scheduling_latency_s":4.949295,"redis_calls":15,"redis_duration_s":0.001758,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001136,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":1,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":1,"duration_s":0.02268,"completed_at":"2026-08-16T17:30:22.822Z","load_balancing_strategy":"primary","db_duration_s":0.003941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 246.565554] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"c8328d72d52d1b0177fa424f","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-c8328d72d52d1b0177fa424f: start","job_status":"start","queue_duration_s":4.973131,"scheduling_latency_s":4.973149}1433gitlab # [ 246.578060] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"c8328d72d52d1b0177fa424f","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-c8328d72d52d1b0177fa424f: done: 0.021817 sec","job_status":"done","queue_duration_s":4.973131,"scheduling_latency_s":4.973149,"redis_calls":15,"redis_duration_s":0.001745,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.021817,"completed_at":"2026-08-16T17:30:22.845Z","load_balancing_strategy":"primary","db_duration_s":0.002262,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 246.619217] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:22.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"41aac1c6a3c66f27987a106d","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-41aac1c6a3c66f27987a106d: start","job_status":"start","queue_duration_s":4.996027,"scheduling_latency_s":4.996045}1435gitlab # [ 246.631833] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:30:23.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"41aac1c6a3c66f27987a106d","created_at":"2026-08-16T17:30:17.786Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-1d7e9d2deb584dd7","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"433277e82f2f0d8f9ebc6286803a1445","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:30:17.850Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-41aac1c6a3c66f27987a106d: done: 0.169533 sec","job_status":"done","queue_duration_s":4.996027,"scheduling_latency_s":4.996045,"redis_calls":15,"redis_duration_s":0.0019160000000000002,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":2,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":2,"duration_s":0.169533,"completed_at":"2026-08-16T17:30:23.016Z","load_balancing_strategy":"primary","db_duration_s":0.004143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 270.225569] setup-gitlab-start[2942]: W, [2026-08-16T17:30:47.039318 #2942] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1437gitlab # [ 289.304120] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:06.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c5cf13af5a3f623706804a28","created_at":"2026-08-16T17:31:06.101Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65e8c9074e0702b98d57c0399dd8b951","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.111Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c5cf13af5a3f623706804a28: start","job_status":"start","queue_duration_s":0.004048,"scheduling_latency_s":0.004111}1438gitlab # [ 289.507816] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:06.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c5cf13af5a3f623706804a28","created_at":"2026-08-16T17:31:06.101Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65e8c9074e0702b98d57c0399dd8b951","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.111Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c5cf13af5a3f623706804a28: done: 0.206211 sec","job_status":"done","queue_duration_s":0.004048,"scheduling_latency_s":0.004111,"redis_calls":14,"redis_duration_s":0.029876,"redis_read_bytes":901,"redis_write_bytes":1246,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.013646,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":470,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01387,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.206211,"completed_at":"2026-08-16T17:31:06.322Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 289.595440] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:06.332Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"95f285e7f869ff8374be93f9","created_at":"2026-08-16T17:31:06.178Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e1269cb38fefd2b4996a40281484a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.185Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-95f285e7f869ff8374be93f9: start","job_status":"start","queue_duration_s":0.147484,"scheduling_latency_s":0.147507}1440gitlab # [ 290.166662] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:06.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"95f285e7f869ff8374be93f9","created_at":"2026-08-16T17:31:06.178Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57e1269cb38fefd2b4996a40281484a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.185Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-95f285e7f869ff8374be93f9: done: 0.648034 sec","job_status":"done","queue_duration_s":0.147484,"scheduling_latency_s":0.147507,"redis_calls":9,"redis_duration_s":0.005972,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002931,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.121,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.121,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.325217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00203926,"exclusive_lock_hold_duration_s":0.47662854,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.648034,"completed_at":"2026-08-16T17:31:06.980Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.201845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 290.274285] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:06.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d8d20e0bbee65879c27967a3","created_at":"2026-08-16T17:31:06.194Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e196e4bcca28b3a784e17cd57a1d38d2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.199Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d8d20e0bbee65879c27967a3: start","job_status":"start","queue_duration_s":0.783331,"scheduling_latency_s":0.783353}1442gitlab # [ 290.293393] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.005Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d8d20e0bbee65879c27967a3","created_at":"2026-08-16T17:31:06.194Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e196e4bcca28b3a784e17cd57a1d38d2","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.199Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d8d20e0bbee65879c27967a3: done: 0.022749 sec","job_status":"done","queue_duration_s":0.783331,"scheduling_latency_s":0.783353,"redis_calls":8,"redis_duration_s":0.001991,"redis_read_bytes":133,"redis_write_bytes":875,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00023,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000499,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.022749,"completed_at":"2026-08-16T17:31:07.005Z","load_balancing_strategy":"primary","db_duration_s":0.006536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 290.339332] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.007Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4bd109dd8c02b61af0eae32e","created_at":"2026-08-16T17:31:06.243Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e95e4c1f009735d95ec936b83a7701ed","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.261Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4bd109dd8c02b61af0eae32e: start","job_status":"start","queue_duration_s":0.745832,"scheduling_latency_s":0.745871}1444gitlab # [ 290.354003] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4bd109dd8c02b61af0eae32e","created_at":"2026-08-16T17:31:06.243Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e95e4c1f009735d95ec936b83a7701ed","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.261Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4bd109dd8c02b61af0eae32e: done: 0.020863 sec","job_status":"done","queue_duration_s":0.745832,"scheduling_latency_s":0.745871,"redis_calls":10,"redis_duration_s":0.002543,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001509,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00484702,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020863,"completed_at":"2026-08-16T17:31:07.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002092,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1445gitlab # [ 290.396500] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8d3f61a72f6edfa91c75c93a","created_at":"2026-08-16T17:31:06.284Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74d6ad104e5af80e2e10eeaa0f13813d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:31:06.297Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8d3f61a72f6edfa91c75c93a: start","job_status":"start","queue_duration_s":0.732216,"scheduling_latency_s":0.732232}1446gitlab # [ 290.411007] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.036Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1447gitlab # [ 290.414420] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.041Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8d3f61a72f6edfa91c75c93a","created_at":"2026-08-16T17:31:06.284Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"74d6ad104e5af80e2e10eeaa0f13813d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:31:06.297Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8d3f61a72f6edfa91c75c93a: done: 0.012564 sec","job_status":"done","queue_duration_s":0.732216,"scheduling_latency_s":0.732232,"redis_calls":7,"redis_duration_s":0.0016289999999999998,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012564,"completed_at":"2026-08-16T17:31:07.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 290.453856] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0084a97a6dab00382e2953e6","created_at":"2026-08-16T17:31:06.313Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.320Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0084a97a6dab00382e2953e6: start","job_status":"start","queue_duration_s":0.723019,"scheduling_latency_s":0.723033}1449gitlab # [ 290.467464] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.068Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"0084a97a6dab00382e2953e6","created_at":"2026-08-16T17:31:06.313Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.320Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-0084a97a6dab00382e2953e6: done: 0.02548 sec","job_status":"done","queue_duration_s":0.723019,"scheduling_latency_s":0.723033,"redis_calls":14,"redis_duration_s":0.0033150000000000002,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000373,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002222,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02548,"completed_at":"2026-08-16T17:31:07.068Z","load_balancing_strategy":"primary","db_duration_s":0.000532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 290.508689] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.070Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3a5000b90b3157ab647dae57","created_at":"2026-08-16T17:31:06.331Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d2dd3d5ef844cc20b21bea662198620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.338Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3a5000b90b3157ab647dae57: start","job_status":"start","queue_duration_s":0.732224,"scheduling_latency_s":0.732239}1451gitlab # [ 290.522951] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.077Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1452gitlab # [ 290.526158] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"3a5000b90b3157ab647dae57","created_at":"2026-08-16T17:31:06.331Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d2dd3d5ef844cc20b21bea662198620","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.338Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-3a5000b90b3157ab647dae57: done: 0.012456 sec","job_status":"done","queue_duration_s":0.732224,"scheduling_latency_s":0.732239,"redis_calls":7,"redis_duration_s":0.001611,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012456,"completed_at":"2026-08-16T17:31:07.082Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 290.566778] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7b9d09237802aea2694f7fef","created_at":"2026-08-16T17:31:06.345Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17f7e93c10e5477536e5822f68bd09ac","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.351Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7b9d09237802aea2694f7fef: start","job_status":"start","queue_duration_s":0.732378,"scheduling_latency_s":0.732392}1454gitlab # [ 290.581036] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7b9d09237802aea2694f7fef","created_at":"2026-08-16T17:31:06.345Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17f7e93c10e5477536e5822f68bd09ac","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.351Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7b9d09237802aea2694f7fef: done: 0.015919 sec","job_status":"done","queue_duration_s":0.732378,"scheduling_latency_s":0.732392,"redis_calls":9,"redis_duration_s":0.0021650000000000003,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001175,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009824,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052458,"exclusive_lock_hold_duration_s":0.0025508,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015919,"completed_at":"2026-08-16T17:31:07.100Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 290.624065] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a860dcfa9415db1eb6699b6b","created_at":"2026-08-16T17:31:06.359Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e65d88ff4d6288c684f5019f4aac660","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:31:06.364Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a860dcfa9415db1eb6699b6b: start","job_status":"start","queue_duration_s":0.737221,"scheduling_latency_s":0.737237}1456gitlab # [ 290.637029] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a860dcfa9415db1eb6699b6b","created_at":"2026-08-16T17:31:06.359Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e65d88ff4d6288c684f5019f4aac660","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:31:06.364Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a860dcfa9415db1eb6699b6b: done: 0.020101 sec","job_status":"done","queue_duration_s":0.737221,"scheduling_latency_s":0.737237,"redis_calls":7,"redis_duration_s":0.0016779999999999998,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020101,"completed_at":"2026-08-16T17:31:07.121Z","load_balancing_strategy":"primary","db_duration_s":0.001563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 290.676444] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"76a96f84a83ea35fe6ead986","created_at":"2026-08-16T17:31:06.382Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"516858300092700656c9f4cca8982317","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.385Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-76a96f84a83ea35fe6ead986: start","job_status":"start","queue_duration_s":0.737287,"scheduling_latency_s":0.737303}1458gitlab # [ 290.691058] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"76a96f84a83ea35fe6ead986","created_at":"2026-08-16T17:31:06.382Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"516858300092700656c9f4cca8982317","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.385Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-76a96f84a83ea35fe6ead986: done: 0.04879 sec","job_status":"done","queue_duration_s":0.737287,"scheduling_latency_s":0.737303,"redis_calls":9,"redis_duration_s":0.002545,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001196,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006428,"exclusive_lock_hold_duration_s":0.01888756,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.04879,"completed_at":"2026-08-16T17:31:07.171Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 290.734148] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"36cb813d7a55a948200217fe","created_at":"2026-08-16T17:31:06.392Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16d6c6a7e4846954a277cfdab743e3cf","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.394Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-36cb813d7a55a948200217fe: start","job_status":"start","queue_duration_s":0.780175,"scheduling_latency_s":0.780216}1460gitlab # [ 290.755084] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"36cb813d7a55a948200217fe","created_at":"2026-08-16T17:31:06.392Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16d6c6a7e4846954a277cfdab743e3cf","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.394Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-36cb813d7a55a948200217fe: done: 0.394533 sec","job_status":"done","queue_duration_s":0.780175,"scheduling_latency_s":0.780216,"redis_calls":562,"redis_duration_s":0.087457,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.086167,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.345056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.394533,"completed_at":"2026-08-16T17:31:07.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 290.795456] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3078b3543c891e9ea80e8b13","created_at":"2026-08-16T17:31:06.398Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a95be418d1a548605cb7c6bc3056d2f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:31:06.401Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3078b3543c891e9ea80e8b13: start","job_status":"start","queue_duration_s":1.169824,"scheduling_latency_s":1.169854}1462gitlab # [ 290.809092] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.578Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1463gitlab # [ 290.812718] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3078b3543c891e9ea80e8b13","created_at":"2026-08-16T17:31:06.398Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a95be418d1a548605cb7c6bc3056d2f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:31:06.401Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3078b3543c891e9ea80e8b13: done: 0.013653 sec","job_status":"done","queue_duration_s":1.169824,"scheduling_latency_s":1.169854,"redis_calls":7,"redis_duration_s":0.0013180000000000002,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013653,"completed_at":"2026-08-16T17:31:07.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 290.853040] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3aca21f9673d47f0df5b5623","created_at":"2026-08-16T17:31:06.405Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af18a1b7c2e1a5786d3d3ad96daee19","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.408Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3aca21f9673d47f0df5b5623: start","job_status":"start","queue_duration_s":1.178279,"scheduling_latency_s":1.178301}1465gitlab # [ 290.866901] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3aca21f9673d47f0df5b5623","created_at":"2026-08-16T17:31:06.405Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af18a1b7c2e1a5786d3d3ad96daee19","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.408Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3aca21f9673d47f0df5b5623: done: 0.015685 sec","job_status":"done","queue_duration_s":1.178279,"scheduling_latency_s":1.178301,"redis_calls":7,"redis_duration_s":0.001381,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015685,"completed_at":"2026-08-16T17:31:07.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000997,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 290.907336] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f939d603258dfb18c592b4a8","created_at":"2026-08-16T17:31:06.428Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"526e9bc0ccf7d9cc6beab271dd13c9d0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.430Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f939d603258dfb18c592b4a8: start","job_status":"start","queue_duration_s":1.172856,"scheduling_latency_s":1.172879}1467gitlab # [ 290.921613] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.634Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f939d603258dfb18c592b4a8","created_at":"2026-08-16T17:31:06.428Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"526e9bc0ccf7d9cc6beab271dd13c9d0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.430Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f939d603258dfb18c592b4a8: done: 0.030972 sec","job_status":"done","queue_duration_s":1.172856,"scheduling_latency_s":1.172879,"redis_calls":7,"redis_duration_s":0.0021739999999999997,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030972,"completed_at":"2026-08-16T17:31:07.634Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 290.961792] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"be5d1cbe17ef3f7bc264a632","created_at":"2026-08-16T17:31:06.444Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c02c89d25e91052809512480db12b2a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.447Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-be5d1cbe17ef3f7bc264a632: start","job_status":"start","queue_duration_s":1.19085,"scheduling_latency_s":1.190893}1469gitlab # [ 290.976505] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"be5d1cbe17ef3f7bc264a632","created_at":"2026-08-16T17:31:06.444Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c02c89d25e91052809512480db12b2a5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.447Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-be5d1cbe17ef3f7bc264a632: done: 0.031182 sec","job_status":"done","queue_duration_s":1.19085,"scheduling_latency_s":1.190893,"redis_calls":7,"redis_duration_s":0.002143,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031182,"completed_at":"2026-08-16T17:31:07.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 291.017150] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"efd16f405983371d1ff643ca","created_at":"2026-08-16T17:31:06.451Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.454Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-efd16f405983371d1ff643ca: start","job_status":"start","queue_duration_s":1.218135,"scheduling_latency_s":1.21817}1471gitlab # [ 291.059864] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"efd16f405983371d1ff643ca","created_at":"2026-08-16T17:31:06.451Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.454Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-efd16f405983371d1ff643ca: done: 0.200151 sec","job_status":"done","queue_duration_s":1.218135,"scheduling_latency_s":1.21817,"redis_calls":60,"redis_duration_s":0.022295,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.00176,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01966,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.200151,"completed_at":"2026-08-16T17:31:07.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 291.101397] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7f5172a43753a04c438943a3","created_at":"2026-08-16T17:31:06.496Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c824e3689459392cd417fbe2596fae34","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.502Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7f5172a43753a04c438943a3: start","job_status":"start","queue_duration_s":1.374365,"scheduling_latency_s":1.374409}1473gitlab # [ 291.115391] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"7f5172a43753a04c438943a3","created_at":"2026-08-16T17:31:06.496Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c824e3689459392cd417fbe2596fae34","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.502Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-7f5172a43753a04c438943a3: done: 0.03124 sec","job_status":"done","queue_duration_s":1.374365,"scheduling_latency_s":1.374409,"redis_calls":9,"redis_duration_s":0.002419,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001129,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00086106,"exclusive_lock_hold_duration_s":0.00494302,"duration_s":0.03124,"completed_at":"2026-08-16T17:31:07.907Z","load_balancing_strategy":"primary","db_duration_s":0.000811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 291.155664] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1b6b4fff8685630583bed3de","created_at":"2026-08-16T17:31:06.538Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f40e8c22756526a85e55c9b839354d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.543Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1b6b4fff8685630583bed3de: start","job_status":"start","queue_duration_s":1.366438,"scheduling_latency_s":1.366466}1475gitlab # [ 291.170706] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.921Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1476gitlab # [ 291.174432] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1b6b4fff8685630583bed3de","created_at":"2026-08-16T17:31:06.538Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f40e8c22756526a85e55c9b839354d6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.543Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1b6b4fff8685630583bed3de: done: 0.018649 sec","job_status":"done","queue_duration_s":1.366438,"scheduling_latency_s":1.366466,"redis_calls":7,"redis_duration_s":0.001277,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000359,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018649,"completed_at":"2026-08-16T17:31:07.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 291.215341] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"077b0ba27977bbcabba5eb31","created_at":"2026-08-16T17:31:06.568Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2d407c2b919ce23e314b2e45821a15c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.578Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-077b0ba27977bbcabba5eb31: start","job_status":"start","queue_duration_s":1.352801,"scheduling_latency_s":1.352825}1478gitlab # [ 291.231458] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.939Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1479gitlab # [ 291.235062] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"077b0ba27977bbcabba5eb31","created_at":"2026-08-16T17:31:06.568Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2d407c2b919ce23e314b2e45821a15c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.578Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-077b0ba27977bbcabba5eb31: done: 0.015203 sec","job_status":"done","queue_duration_s":1.352801,"scheduling_latency_s":1.352825,"redis_calls":7,"redis_duration_s":0.001078,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015203,"completed_at":"2026-08-16T17:31:07.946Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 291.276308] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:07.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d90b69febfe1df1c39899370","created_at":"2026-08-16T17:31:06.607Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a1674359d9ae89b4bb69a1d595c5d38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.612Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d90b69febfe1df1c39899370: start","job_status":"start","queue_duration_s":1.335427,"scheduling_latency_s":1.335444}1481gitlab # [ 291.290960] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d90b69febfe1df1c39899370","created_at":"2026-08-16T17:31:06.607Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a1674359d9ae89b4bb69a1d595c5d38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.612Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d90b69febfe1df1c39899370: done: 0.058771 sec","job_status":"done","queue_duration_s":1.335427,"scheduling_latency_s":1.335444,"redis_calls":9,"redis_duration_s":0.002342,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001365,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055906,"exclusive_lock_hold_duration_s":0.0394285,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.058771,"completed_at":"2026-08-16T17:31:08.006Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 291.334527] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"98210de733cac238fc204b69","created_at":"2026-08-16T17:31:06.639Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d57433a0b34b0d4f6bc2ac6e7a7b2a8d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.646Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-98210de733cac238fc204b69: start","job_status":"start","queue_duration_s":1.364677,"scheduling_latency_s":1.364704}1483gitlab # [ 291.349822] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.022Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1484gitlab # [ 291.353917] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"98210de733cac238fc204b69","created_at":"2026-08-16T17:31:06.639Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-b7f2efb2b0264460","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d57433a0b34b0d4f6bc2ac6e7a7b2a8d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:06.646Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-98210de733cac238fc204b69: done: 0.020292 sec","job_status":"done","queue_duration_s":1.364677,"scheduling_latency_s":1.364704,"redis_calls":7,"redis_duration_s":0.001438,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020292,"completed_at":"2026-08-16T17:31:08.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 291.394289] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.032Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ef3780978e51bc8f3b81567","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ef3780978e51bc8f3b81567: start","job_status":"start","queue_duration_s":0.969375,"scheduling_latency_s":0.969396}1486gitlab # [ 291.406707] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.046Z","message":"No existing merge request to be cleaned up."}1487gitlab # [ 291.408404] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.056Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ef3780978e51bc8f3b81567","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ef3780978e51bc8f3b81567: done: 0.024179 sec","job_status":"done","queue_duration_s":0.969375,"scheduling_latency_s":0.969396,"redis_calls":10,"redis_duration_s":0.001706,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024179,"completed_at":"2026-08-16T17:31:08.056Z","load_balancing_strategy":"primary","db_duration_s":0.001908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 291.447655] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.057Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d7eba408cc52357cb8679f4a","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d7eba408cc52357cb8679f4a: start","job_status":"start","queue_duration_s":0.994808,"scheduling_latency_s":0.994825}1489gitlab # [ 291.460132] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.070Z","message":"No existing merge request to be cleaned up."}1490gitlab # [ 291.461740] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.079Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d7eba408cc52357cb8679f4a","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d7eba408cc52357cb8679f4a: done: 0.021269 sec","job_status":"done","queue_duration_s":0.994808,"scheduling_latency_s":0.994825,"redis_calls":10,"redis_duration_s":0.001593,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000781,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000812,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021269,"completed_at":"2026-08-16T17:31:08.079Z","load_balancing_strategy":"primary","db_duration_s":0.001391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 291.500067] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.080Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ed92465dce7f06b0e2987e7","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ed92465dce7f06b0e2987e7: start","job_status":"start","queue_duration_s":1.017153,"scheduling_latency_s":1.017168}1492gitlab # [ 291.512266] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.089Z","message":"No existing merge request to be cleaned up."}1493gitlab # [ 291.513868] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.098Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ed92465dce7f06b0e2987e7","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ed92465dce7f06b0e2987e7: done: 0.018244 sec","job_status":"done","queue_duration_s":1.017153,"scheduling_latency_s":1.017168,"redis_calls":10,"redis_duration_s":0.001364,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000789,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018244,"completed_at":"2026-08-16T17:31:08.098Z","load_balancing_strategy":"primary","db_duration_s":0.001421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 291.552224] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.099Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d6377a2984844c5d3b8b810b","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d6377a2984844c5d3b8b810b: start","job_status":"start","queue_duration_s":1.036781,"scheduling_latency_s":1.036797}1495gitlab # [ 291.564284] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.110Z","message":"No existing merge request to be cleaned up."}1496gitlab # [ 291.565928] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.117Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d6377a2984844c5d3b8b810b","created_at":"2026-08-16T17:31:07.053Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-0f15d71e378a45b2","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"ead8d9d655de3dff0d2040888114fd41","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.063Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d6377a2984844c5d3b8b810b: done: 0.017578 sec","job_status":"done","queue_duration_s":1.036781,"scheduling_latency_s":1.036797,"redis_calls":10,"redis_duration_s":0.001304,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017578,"completed_at":"2026-08-16T17:31:08.117Z","load_balancing_strategy":"primary","db_duration_s":0.001246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 291.604070] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c21af9d2df22ac033f2d0ae","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c21af9d2df22ac033f2d0ae: start","job_status":"start","queue_duration_s":0.265855,"scheduling_latency_s":0.26587}1498gitlab # [ 291.616404] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c21af9d2df22ac033f2d0ae","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c21af9d2df22ac033f2d0ae: done: 0.014706 sec","job_status":"done","queue_duration_s":0.265855,"scheduling_latency_s":0.26587,"redis_calls":13,"redis_duration_s":0.002146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001597,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014706,"completed_at":"2026-08-16T17:31:08.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 291.656465] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7bbbb390977732160ecea69","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7bbbb390977732160ecea69: start","job_status":"start","queue_duration_s":0.281644,"scheduling_latency_s":0.28166}1500gitlab # [ 291.668793] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7bbbb390977732160ecea69","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7bbbb390977732160ecea69: done: 0.014328 sec","job_status":"done","queue_duration_s":0.281644,"scheduling_latency_s":0.28166,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014328,"completed_at":"2026-08-16T17:31:08.149Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 291.707834] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"762dabdf500550fd1344408f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-762dabdf500550fd1344408f: start","job_status":"start","queue_duration_s":0.296993,"scheduling_latency_s":0.297008}1502gitlab # [ 291.720145] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"762dabdf500550fd1344408f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-762dabdf500550fd1344408f: done: 0.014204 sec","job_status":"done","queue_duration_s":0.296993,"scheduling_latency_s":0.297008,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014204,"completed_at":"2026-08-16T17:31:08.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 291.759734] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d620a10d57c2f4b660caf36","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d620a10d57c2f4b660caf36: start","job_status":"start","queue_duration_s":0.312205,"scheduling_latency_s":0.31222}1504gitlab # [ 291.772456] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d620a10d57c2f4b660caf36","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d620a10d57c2f4b660caf36: done: 0.015076 sec","job_status":"done","queue_duration_s":0.312205,"scheduling_latency_s":0.31222,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015076,"completed_at":"2026-08-16T17:31:08.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 291.811643] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08a0461494460a1b84a7d10","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08a0461494460a1b84a7d10: start","job_status":"start","queue_duration_s":0.328367,"scheduling_latency_s":0.328382}1506gitlab # [ 291.824122] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08a0461494460a1b84a7d10","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08a0461494460a1b84a7d10: done: 0.013963 sec","job_status":"done","queue_duration_s":0.328367,"scheduling_latency_s":0.328382,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013963,"completed_at":"2026-08-16T17:31:08.196Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 291.864231] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d520c02c282a199268cd64d","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d520c02c282a199268cd64d: start","job_status":"start","queue_duration_s":0.343368,"scheduling_latency_s":0.343383}1508gitlab # [ 291.876679] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d520c02c282a199268cd64d","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d520c02c282a199268cd64d: done: 0.013831 sec","job_status":"done","queue_duration_s":0.343368,"scheduling_latency_s":0.343383,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013831,"completed_at":"2026-08-16T17:31:08.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 291.915792] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"016623b6bf78bae06bf72250","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-016623b6bf78bae06bf72250: start","job_status":"start","queue_duration_s":0.358208,"scheduling_latency_s":0.358224}1510gitlab # [ 291.928480] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"016623b6bf78bae06bf72250","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-016623b6bf78bae06bf72250: done: 0.015814 sec","job_status":"done","queue_duration_s":0.358208,"scheduling_latency_s":0.358224,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015814,"completed_at":"2026-08-16T17:31:08.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 291.967529] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102e182fac7cedf1cb426c54","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102e182fac7cedf1cb426c54: start","job_status":"start","queue_duration_s":0.375461,"scheduling_latency_s":0.375476}1512gitlab # [ 291.980139] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102e182fac7cedf1cb426c54","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102e182fac7cedf1cb426c54: done: 0.014109 sec","job_status":"done","queue_duration_s":0.375461,"scheduling_latency_s":0.375476,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014109,"completed_at":"2026-08-16T17:31:08.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 292.019139] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea861d17ad5b109dac0f289c","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea861d17ad5b109dac0f289c: start","job_status":"start","queue_duration_s":0.390578,"scheduling_latency_s":0.390593}1514gitlab # [ 292.031443] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea861d17ad5b109dac0f289c","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea861d17ad5b109dac0f289c: done: 0.013996 sec","job_status":"done","queue_duration_s":0.390578,"scheduling_latency_s":0.390593,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013996,"completed_at":"2026-08-16T17:31:08.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 292.072076] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b129547292fa03c1fe23b4f6","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b129547292fa03c1fe23b4f6: start","job_status":"start","queue_duration_s":0.405601,"scheduling_latency_s":0.405617}1516gitlab # [ 292.084578] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b129547292fa03c1fe23b4f6","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b129547292fa03c1fe23b4f6: done: 0.014769 sec","job_status":"done","queue_duration_s":0.405601,"scheduling_latency_s":0.405617,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014769,"completed_at":"2026-08-16T17:31:08.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 292.124751] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9e1153fb58fec8bc6ec5e0a","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9e1153fb58fec8bc6ec5e0a: start","job_status":"start","queue_duration_s":0.421484,"scheduling_latency_s":0.4215}1518gitlab # [ 292.137294] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9e1153fb58fec8bc6ec5e0a","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9e1153fb58fec8bc6ec5e0a: done: 0.014539 sec","job_status":"done","queue_duration_s":0.421484,"scheduling_latency_s":0.4215,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014539,"completed_at":"2026-08-16T17:31:08.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 292.176773] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e9edf3692af5171b5c0cb66","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e9edf3692af5171b5c0cb66: start","job_status":"start","queue_duration_s":0.437047,"scheduling_latency_s":0.437063}1520gitlab # [ 292.189432] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e9edf3692af5171b5c0cb66","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e9edf3692af5171b5c0cb66: done: 0.013993 sec","job_status":"done","queue_duration_s":0.437047,"scheduling_latency_s":0.437063,"redis_calls":13,"redis_duration_s":0.0014390000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013993,"completed_at":"2026-08-16T17:31:08.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 292.229066] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2a79e72322ad7d47da12b68","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2a79e72322ad7d47da12b68: start","job_status":"start","queue_duration_s":0.452051,"scheduling_latency_s":0.452067}1522gitlab # [ 292.241589] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2a79e72322ad7d47da12b68","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2a79e72322ad7d47da12b68: done: 0.014474 sec","job_status":"done","queue_duration_s":0.452051,"scheduling_latency_s":0.452067,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014474,"completed_at":"2026-08-16T17:31:08.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 292.282361] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e108c86840656c0f41b662ef","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e108c86840656c0f41b662ef: start","job_status":"start","queue_duration_s":0.467637,"scheduling_latency_s":0.467653}1524gitlab # [ 292.294978] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e108c86840656c0f41b662ef","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e108c86840656c0f41b662ef: done: 0.01385 sec","job_status":"done","queue_duration_s":0.467637,"scheduling_latency_s":0.467653,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01385,"completed_at":"2026-08-16T17:31:08.335Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 292.334105] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c83c76c3bdb5cc447d90e4be","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c83c76c3bdb5cc447d90e4be: start","job_status":"start","queue_duration_s":0.482518,"scheduling_latency_s":0.482533}1526gitlab # [ 292.346723] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c83c76c3bdb5cc447d90e4be","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c83c76c3bdb5cc447d90e4be: done: 0.013832 sec","job_status":"done","queue_duration_s":0.482518,"scheduling_latency_s":0.482533,"redis_calls":13,"redis_duration_s":0.0014260000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013832,"completed_at":"2026-08-16T17:31:08.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 292.386505] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf9d2c42099dfc2f7b8fe815","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf9d2c42099dfc2f7b8fe815: start","job_status":"start","queue_duration_s":0.497441,"scheduling_latency_s":0.497457}1528gitlab # [ 292.398930] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf9d2c42099dfc2f7b8fe815","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf9d2c42099dfc2f7b8fe815: done: 0.014629 sec","job_status":"done","queue_duration_s":0.497441,"scheduling_latency_s":0.497457,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014629,"completed_at":"2026-08-16T17:31:08.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 292.438339] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723ff470b9cf4bf582d01f1c","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723ff470b9cf4bf582d01f1c: start","job_status":"start","queue_duration_s":0.513118,"scheduling_latency_s":0.513134}1530gitlab # [ 292.450922] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723ff470b9cf4bf582d01f1c","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723ff470b9cf4bf582d01f1c: done: 0.013809 sec","job_status":"done","queue_duration_s":0.513118,"scheduling_latency_s":0.513134,"redis_calls":13,"redis_duration_s":0.001632,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013809,"completed_at":"2026-08-16T17:31:08.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 292.491197] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffb9ce203f10e644e5859463","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffb9ce203f10e644e5859463: start","job_status":"start","queue_duration_s":0.527957,"scheduling_latency_s":0.527973}1532gitlab # [ 292.503787] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffb9ce203f10e644e5859463","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffb9ce203f10e644e5859463: done: 0.013767 sec","job_status":"done","queue_duration_s":0.527957,"scheduling_latency_s":0.527973,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013767,"completed_at":"2026-08-16T17:31:08.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 292.543294] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7baff0b5c2de58c54a502eb2","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7baff0b5c2de58c54a502eb2: start","job_status":"start","queue_duration_s":0.542758,"scheduling_latency_s":0.542773}1534gitlab # [ 292.556341] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7baff0b5c2de58c54a502eb2","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7baff0b5c2de58c54a502eb2: done: 0.013971 sec","job_status":"done","queue_duration_s":0.542758,"scheduling_latency_s":0.542773,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013971,"completed_at":"2026-08-16T17:31:08.410Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 292.595811] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab17365fc4f8205ff42f9b63","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab17365fc4f8205ff42f9b63: start","job_status":"start","queue_duration_s":0.558123,"scheduling_latency_s":0.558138}1536gitlab # [ 292.608349] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab17365fc4f8205ff42f9b63","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab17365fc4f8205ff42f9b63: done: 0.013955 sec","job_status":"done","queue_duration_s":0.558123,"scheduling_latency_s":0.558138,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013955,"completed_at":"2026-08-16T17:31:08.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 292.648114] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e7e3b51948678ec5e121a14","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e7e3b51948678ec5e121a14: start","job_status":"start","queue_duration_s":0.573125,"scheduling_latency_s":0.57314}1538gitlab # [ 292.661431] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e7e3b51948678ec5e121a14","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e7e3b51948678ec5e121a14: done: 0.01397 sec","job_status":"done","queue_duration_s":0.573125,"scheduling_latency_s":0.57314,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01397,"completed_at":"2026-08-16T17:31:08.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 292.700572] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f63d9da0ea91c1ab66b2f3a","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f63d9da0ea91c1ab66b2f3a: start","job_status":"start","queue_duration_s":0.588149,"scheduling_latency_s":0.588164}1540gitlab # [ 292.712827] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f63d9da0ea91c1ab66b2f3a","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f63d9da0ea91c1ab66b2f3a: done: 0.013432 sec","job_status":"done","queue_duration_s":0.588149,"scheduling_latency_s":0.588164,"redis_calls":13,"redis_duration_s":0.001384,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013432,"completed_at":"2026-08-16T17:31:08.455Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 292.752292] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"818190bb1335b523f2ee303f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-818190bb1335b523f2ee303f: start","job_status":"start","queue_duration_s":0.602662,"scheduling_latency_s":0.602678}1542gitlab # [ 292.764688] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"818190bb1335b523f2ee303f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-818190bb1335b523f2ee303f: done: 0.013548 sec","job_status":"done","queue_duration_s":0.602662,"scheduling_latency_s":0.602678,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013548,"completed_at":"2026-08-16T17:31:08.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 292.803985] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9be118a7b598a8075d8f8955","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9be118a7b598a8075d8f8955: start","job_status":"start","queue_duration_s":0.617293,"scheduling_latency_s":0.617308}1544gitlab # [ 292.816254] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9be118a7b598a8075d8f8955","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9be118a7b598a8075d8f8955: done: 0.014007 sec","job_status":"done","queue_duration_s":0.617293,"scheduling_latency_s":0.617308,"redis_calls":13,"redis_duration_s":0.001751,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014007,"completed_at":"2026-08-16T17:31:08.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 292.855529] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a3de366e85062c38f02f3ef","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a3de366e85062c38f02f3ef: start","job_status":"start","queue_duration_s":0.632298,"scheduling_latency_s":0.632314}1546gitlab # [ 292.868869] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a3de366e85062c38f02f3ef","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a3de366e85062c38f02f3ef: done: 0.013404 sec","job_status":"done","queue_duration_s":0.632298,"scheduling_latency_s":0.632314,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013404,"completed_at":"2026-08-16T17:31:08.499Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 292.908539] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c5803cd16c897274996e258","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c5803cd16c897274996e258: start","job_status":"start","queue_duration_s":0.646739,"scheduling_latency_s":0.646754}1548gitlab # [ 292.920988] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c5803cd16c897274996e258","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c5803cd16c897274996e258: done: 0.01347 sec","job_status":"done","queue_duration_s":0.646739,"scheduling_latency_s":0.646754,"redis_calls":13,"redis_duration_s":0.0014069999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01347,"completed_at":"2026-08-16T17:31:08.514Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 292.959957] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5186d05522405a7c1ba419f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5186d05522405a7c1ba419f: start","job_status":"start","queue_duration_s":0.661415,"scheduling_latency_s":0.661431}1550gitlab # [ 292.972604] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5186d05522405a7c1ba419f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5186d05522405a7c1ba419f: done: 0.013492 sec","job_status":"done","queue_duration_s":0.661415,"scheduling_latency_s":0.661431,"redis_calls":13,"redis_duration_s":0.001404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013492,"completed_at":"2026-08-16T17:31:08.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 293.011544] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d74e3e5d808b379eb6a2b0","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d74e3e5d808b379eb6a2b0: start","job_status":"start","queue_duration_s":0.676047,"scheduling_latency_s":0.676062}1552gitlab # [ 293.023919] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0d74e3e5d808b379eb6a2b0","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0d74e3e5d808b379eb6a2b0: done: 0.013464 sec","job_status":"done","queue_duration_s":0.676047,"scheduling_latency_s":0.676062,"redis_calls":13,"redis_duration_s":0.0014030000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013464,"completed_at":"2026-08-16T17:31:08.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 293.063274] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3f79a1cc4d40dd0044b0291","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3f79a1cc4d40dd0044b0291: start","job_status":"start","queue_duration_s":0.690541,"scheduling_latency_s":0.690556}1554gitlab # [ 293.076419] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3f79a1cc4d40dd0044b0291","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3f79a1cc4d40dd0044b0291: done: 0.013611 sec","job_status":"done","queue_duration_s":0.690541,"scheduling_latency_s":0.690556,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013611,"completed_at":"2026-08-16T17:31:08.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 293.115938] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c80f6b57ba79abb61080b4","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c80f6b57ba79abb61080b4: start","job_status":"start","queue_duration_s":0.705242,"scheduling_latency_s":0.705258}1556gitlab # [ 293.128685] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35c80f6b57ba79abb61080b4","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35c80f6b57ba79abb61080b4: done: 0.01353 sec","job_status":"done","queue_duration_s":0.705242,"scheduling_latency_s":0.705258,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01353,"completed_at":"2026-08-16T17:31:08.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 293.168457] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9194dff603cffe067e4c3e0e","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9194dff603cffe067e4c3e0e: start","job_status":"start","queue_duration_s":0.719876,"scheduling_latency_s":0.719892}1558gitlab # [ 293.180818] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9194dff603cffe067e4c3e0e","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9194dff603cffe067e4c3e0e: done: 0.01367 sec","job_status":"done","queue_duration_s":0.719876,"scheduling_latency_s":0.719892,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01367,"completed_at":"2026-08-16T17:31:08.587Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 293.220224] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41787a59ccb6316a3cb93dd5","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41787a59ccb6316a3cb93dd5: start","job_status":"start","queue_duration_s":0.734695,"scheduling_latency_s":0.734711}1560gitlab # [ 293.232590] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41787a59ccb6316a3cb93dd5","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41787a59ccb6316a3cb93dd5: done: 0.013434 sec","job_status":"done","queue_duration_s":0.734695,"scheduling_latency_s":0.734711,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013434,"completed_at":"2026-08-16T17:31:08.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 293.272454] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b072e5c85f2cfdf8f80414ec","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b072e5c85f2cfdf8f80414ec: start","job_status":"start","queue_duration_s":0.749201,"scheduling_latency_s":0.749216}1562gitlab # [ 293.285125] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b072e5c85f2cfdf8f80414ec","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b072e5c85f2cfdf8f80414ec: done: 0.013647 sec","job_status":"done","queue_duration_s":0.749201,"scheduling_latency_s":0.749216,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013647,"completed_at":"2026-08-16T17:31:08.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 293.323852] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9cdcfd8082e14eebc4de881","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9cdcfd8082e14eebc4de881: start","job_status":"start","queue_duration_s":0.763875,"scheduling_latency_s":0.76389}1564gitlab # [ 293.336107] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9cdcfd8082e14eebc4de881","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9cdcfd8082e14eebc4de881: done: 0.013526 sec","job_status":"done","queue_duration_s":0.763875,"scheduling_latency_s":0.76389,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013526,"completed_at":"2026-08-16T17:31:08.631Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 293.374661] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a5b74ea34f3da7bb8fb9654","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a5b74ea34f3da7bb8fb9654: start","job_status":"start","queue_duration_s":0.77843,"scheduling_latency_s":0.778446}1566gitlab # [ 293.387378] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a5b74ea34f3da7bb8fb9654","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a5b74ea34f3da7bb8fb9654: done: 0.013739 sec","job_status":"done","queue_duration_s":0.77843,"scheduling_latency_s":0.778446,"redis_calls":13,"redis_duration_s":0.0013969999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013739,"completed_at":"2026-08-16T17:31:08.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 293.426318] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936a90a34ea50c18148610e4","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936a90a34ea50c18148610e4: start","job_status":"start","queue_duration_s":0.793593,"scheduling_latency_s":0.793609}1568gitlab # [ 293.438485] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936a90a34ea50c18148610e4","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936a90a34ea50c18148610e4: done: 0.013977 sec","job_status":"done","queue_duration_s":0.793593,"scheduling_latency_s":0.793609,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013977,"completed_at":"2026-08-16T17:31:08.661Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 293.477910] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4f5ae9213407f1591abd137","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4f5ae9213407f1591abd137: start","job_status":"start","queue_duration_s":0.8086,"scheduling_latency_s":0.808614}1570gitlab # [ 293.490102] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4f5ae9213407f1591abd137","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4f5ae9213407f1591abd137: done: 0.013687 sec","job_status":"done","queue_duration_s":0.8086,"scheduling_latency_s":0.808614,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013687,"completed_at":"2026-08-16T17:31:08.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 293.528403] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b04f12fff5dd3d9834d78e4","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b04f12fff5dd3d9834d78e4: start","job_status":"start","queue_duration_s":0.823369,"scheduling_latency_s":0.823384}1572gitlab # [ 293.540645] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b04f12fff5dd3d9834d78e4","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b04f12fff5dd3d9834d78e4: done: 0.014373 sec","job_status":"done","queue_duration_s":0.823369,"scheduling_latency_s":0.823384,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014373,"completed_at":"2026-08-16T17:31:08.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 293.579290] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd1cc98065c93ca7c136219","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd1cc98065c93ca7c136219: start","job_status":"start","queue_duration_s":0.839158,"scheduling_latency_s":0.839174}1574gitlab # [ 293.591556] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd1cc98065c93ca7c136219","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd1cc98065c93ca7c136219: done: 0.01382 sec","job_status":"done","queue_duration_s":0.839158,"scheduling_latency_s":0.839174,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01382,"completed_at":"2026-08-16T17:31:08.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 293.630313] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c805d9501cfbb528c8479808","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c805d9501cfbb528c8479808: start","job_status":"start","queue_duration_s":0.854033,"scheduling_latency_s":0.854048}1576gitlab # [ 293.642501] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c805d9501cfbb528c8479808","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c805d9501cfbb528c8479808: done: 0.013924 sec","job_status":"done","queue_duration_s":0.854033,"scheduling_latency_s":0.854048,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013924,"completed_at":"2026-08-16T17:31:08.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 293.681882] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cee2c3dd3d2ffe5822d7297","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cee2c3dd3d2ffe5822d7297: start","job_status":"start","queue_duration_s":0.869002,"scheduling_latency_s":0.86904}1578gitlab # [ 293.694111] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cee2c3dd3d2ffe5822d7297","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cee2c3dd3d2ffe5822d7297: done: 0.013965 sec","job_status":"done","queue_duration_s":0.869002,"scheduling_latency_s":0.86904,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013965,"completed_at":"2026-08-16T17:31:08.736Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 293.732722] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d50966e9b5e9362a5ea9834","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d50966e9b5e9362a5ea9834: start","job_status":"start","queue_duration_s":0.884014,"scheduling_latency_s":0.884029}1580gitlab # [ 293.744727] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d50966e9b5e9362a5ea9834","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d50966e9b5e9362a5ea9834: done: 0.01436 sec","job_status":"done","queue_duration_s":0.884014,"scheduling_latency_s":0.884029,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01436,"completed_at":"2026-08-16T17:31:08.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 293.783218] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"866926c7552d9e7596b0f4df","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-866926c7552d9e7596b0f4df: start","job_status":"start","queue_duration_s":0.899525,"scheduling_latency_s":0.899539}1582gitlab # [ 293.795676] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"866926c7552d9e7596b0f4df","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-866926c7552d9e7596b0f4df: done: 0.013849 sec","job_status":"done","queue_duration_s":0.899525,"scheduling_latency_s":0.899539,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013849,"completed_at":"2026-08-16T17:31:08.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 293.835035] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a16a30c6a38cbb9fec7dec6","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a16a30c6a38cbb9fec7dec6: start","job_status":"start","queue_duration_s":0.914414,"scheduling_latency_s":0.914429}1584gitlab # [ 293.847604] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a16a30c6a38cbb9fec7dec6","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a16a30c6a38cbb9fec7dec6: done: 0.014325 sec","job_status":"done","queue_duration_s":0.914414,"scheduling_latency_s":0.914429,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014325,"completed_at":"2026-08-16T17:31:08.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 293.887690] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e92fb5dabf606c780c61d32e","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e92fb5dabf606c780c61d32e: start","job_status":"start","queue_duration_s":0.930288,"scheduling_latency_s":0.930304}1586gitlab # [ 293.900036] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e92fb5dabf606c780c61d32e","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e92fb5dabf606c780c61d32e: done: 0.013746 sec","job_status":"done","queue_duration_s":0.930288,"scheduling_latency_s":0.930304,"redis_calls":13,"redis_duration_s":0.001379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013746,"completed_at":"2026-08-16T17:31:08.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 293.938981] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9818c2904be10f13cf4e7952","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9818c2904be10f13cf4e7952: start","job_status":"start","queue_duration_s":0.945117,"scheduling_latency_s":0.945133}1588gitlab # [ 293.951538] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9818c2904be10f13cf4e7952","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9818c2904be10f13cf4e7952: done: 0.013922 sec","job_status":"done","queue_duration_s":0.945117,"scheduling_latency_s":0.945133,"redis_calls":13,"redis_duration_s":0.001407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013922,"completed_at":"2026-08-16T17:31:08.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 293.991128] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb532bdeab795b993e369203","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb532bdeab795b993e369203: start","job_status":"start","queue_duration_s":0.960103,"scheduling_latency_s":0.960119}1590gitlab # [ 294.003672] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb532bdeab795b993e369203","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb532bdeab795b993e369203: done: 0.014032 sec","job_status":"done","queue_duration_s":0.960103,"scheduling_latency_s":0.960119,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014032,"completed_at":"2026-08-16T17:31:08.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 294.042461] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00a5622b2ed23957951b224a","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00a5622b2ed23957951b224a: start","job_status":"start","queue_duration_s":0.975498,"scheduling_latency_s":0.975513}1592gitlab # [ 294.054634] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00a5622b2ed23957951b224a","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00a5622b2ed23957951b224a: done: 0.013694 sec","job_status":"done","queue_duration_s":0.975498,"scheduling_latency_s":0.975513,"redis_calls":13,"redis_duration_s":0.0013800000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013694,"completed_at":"2026-08-16T17:31:08.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 294.094210] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a01fe309ba8b35ccd95723","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a01fe309ba8b35ccd95723: start","job_status":"start","queue_duration_s":0.990237,"scheduling_latency_s":0.990252}1594gitlab # [ 294.106455] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a01fe309ba8b35ccd95723","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a01fe309ba8b35ccd95723: done: 0.013773 sec","job_status":"done","queue_duration_s":0.990237,"scheduling_latency_s":0.990252,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013773,"completed_at":"2026-08-16T17:31:08.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 294.145482] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18635eac738815cd6b16880f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18635eac738815cd6b16880f: start","job_status":"start","queue_duration_s":1.005129,"scheduling_latency_s":1.005145}1596gitlab # [ 294.157853] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:08.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18635eac738815cd6b16880f","created_at":"2026-08-16T17:31:07.687Z","trace_propagation_headers":{"sentry-trace":"31169eb1bc484da397509245420973d6-ed6deea2a37c4745","baggage":"sentry-trace_id=31169eb1bc484da397509245420973d6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"dfe913044b25dbe453c86280dcb88cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:07.853Z","job_size_bytes":2,"pid":2019,"sidekiq_tid":"maob","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18635eac738815cd6b16880f: done: 0.013978 sec","job_status":"done","queue_duration_s":1.005129,"scheduling_latency_s":1.005145,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013978,"completed_at":"2026-08-16T17:31:08.873Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 309.286458] redis[789]: 10 changes in 300 seconds. Saving...1598gitlab # [ 309.293880] redis[789]: Background saving started by pid 32881599gitlab # [ 309.299940] redis[3288]: BGSAVE done, 537 keys saved, 0 keys skipped, 132805 bytes written.1600gitlab # [ 309.305093] redis[3288]: DB saved on disk1601gitlab # [ 309.307318] redis[3288]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1602gitlab # [ 309.388315] redis[789]: Background saving terminated with success1603gitlab # [ 310.411858] postgres[867]: [867] LOG: checkpoint starting: time1604gitlab # [ 311.748157] postgres[3273]: [3273] ERROR: relation "table_without_models" does not exist1605gitlab # [ 311.748408] postgres[3273]: [3273] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1606gitlab # [ 311.892731] gitaly[894]: time="2026-08-16T17:31:28.705Z" level=info msg="burden monitor stats" pid=8941607gitlab # [ 317.466730] runuser[2941]: pam_unix(runuser:session): session closed for user gitlab1608gitlab # [ 317.468672] setup-gitlab-start[2919]: + systemctl restart gitlab-sidekiq.service1609gitlab # [ 317.506099] systemd[1]: Stopping gitlab-sidekiq.service...1610gitlab # [ 317.509542] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:34.320Z","message":"Shutting down"}1611gitlab # [ 317.513779] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:34.320Z","message":"Scheduler exiting..."}1612gitlab # [ 317.518066] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:34.321Z","message":"Terminating quiet threads for default capsule"}1613gitlab # [ 317.523245] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:34.321Z","message":"Scheduler exiting..."}1614gitlab # [ 318.007866] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:34.822Z","message":"Pausing to allow jobs to finish..."}1615gitlab # [ 322.513060] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:39.326Z","message":"Bye!"}1616gitlab # [ 322.555048] sidekiq-cluster[2019]: {"severity":"INFO","time":"2026-08-16T17:31:39.369Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2019,"worker_id":"sidekiq_0","memwd_rss_bytes":937930752,"retry":0}1617gitlab # [ 323.266017] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1618gitlab # [ 323.266443] systemd[1]: Stopped gitlab-sidekiq.service.1619gitlab # [ 323.266636] systemd[1]: gitlab-sidekiq.service: Consumed 1min 53.069s CPU time over 3min 20.354s wall clock time, 940.7M memory peak, 4.5M read from disk.1620gitlab # [ 323.280318] systemd[1]: Started gitlab-sidekiq.service.1621gitlab # [ 323.284904] setup-gitlab-start[2919]: + mkdir -p /var/lib/secrets1622gitlab # [ 323.290173] setup-gitlab-start[2919]: + echo nixbot-test-token-of-20-chars1623gitlab # [ 323.293144] setup-gitlab-start[2919]: + chmod 644 /var/lib/secrets/gitlab-token1624gitlab # [ 323.296198] setup-gitlab-start[2919]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1625gitlab # [ 324.926155] gitaly[894]: time="2026-08-16T17:31:41.739Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:51.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:41.739" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 324.956591] gitaly[894]: time="2026-08-16T17:31:41.740Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:51.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:41.739" grpc.time_ms=0.903 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 325.225028] gitaly[894]: time="2026-08-16T17:31:42.039Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.039" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 325.252935] gitaly[894]: time="2026-08-16T17:31:42.040Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.039" grpc.time_ms=0.55 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1629gitlab # [ 325.332807] gitaly[894]: time="2026-08-16T17:31:42.147Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y diskcache=31731066-0907-4d20-a9e5-c7d74991b40b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:31:52.050" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.081" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1630gitlab # [ 325.362910] gitaly[894]: time="2026-08-16T17:31:42.148Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=6 command.system_time_ms=37 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:31:52.050" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.081" grpc.time_ms=66.48 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1631gitlab # [ 325.389111] gitaly[894]: time="2026-08-16T17:31:42.169Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.138" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.168" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1632gitlab # [ 325.405602] gitaly[894]: time="2026-08-16T17:31:42.170Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.138" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.168" grpc.time_ms=1.423 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1633gitlab # [ 325.422930] gitaly[894]: time="2026-08-16T17:31:42.197Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:31:52.148" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.180" grpc.time_ms=16.987 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1634gitlab # [ 325.492738] gitaly[894]: time="2026-08-16T17:31:42.307Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.276" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.306" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1635gitlab # [ 325.522800] gitaly[894]: time="2026-08-16T17:31:42.308Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.276" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.306" grpc.time_ms=0.966 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1636gitlab # [ 325.553451] gitaly[894]: time="2026-08-16T17:31:42.350Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y diskcache=c4ba69ca-7df4-45dd-9af6-67c812a98737 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:31:52.280" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.310" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1637gitlab # [ 325.576383] gitaly[894]: time="2026-08-16T17:31:42.351Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1442 command.oublock=32 command.real_time_ms=19 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:31:52.280" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.310" grpc.time_ms=40.23 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1638gitlab # [ 325.601954] gitaly[894]: time="2026-08-16T17:31:42.360Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.358" pid=894 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1639gitlab # [ 325.618459] gitaly[894]: time="2026-08-16T17:31:42.361Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.358" grpc.time_ms=1.876 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1640gitlab # [ 325.636414] gitaly[894]: time="2026-08-16T17:31:42.375Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:31:52.014" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.365" grpc.time_ms=9.823 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1641gitlab # [ 325.654803] gitaly[894]: time="2026-08-16T17:31:42.419Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:31:52.069" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.419" grpc.time_ms=0.154 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1642gitlab # [ 325.667939] gitaly[894]: time="2026-08-16T17:31:42.429Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:31:52.079" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:42.429" grpc.time_ms=0.377 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1643gitlab # [ 326.397419] gitaly[894]: time="2026-08-16T17:31:43.211Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T247BQ3C71EQ1SPTPMN1Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:31:53.163" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:43.193" grpc.time_ms=17.167 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1644gitlab # [ 326.885018] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:43 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 35591645gitlab # [ 326.889247] setup-gitlab-start[2919]: + mkdir -p /tmp/test-flake1646gitlab # [ 326.894368] setup-gitlab-start[2919]: + cd /tmp/test-flake1647gitlab # [ 326.895277] setup-gitlab-start[2919]: + git init -b master1648gitlab # [ 326.921398] setup-gitlab-start[3401]: Initialized empty Git repository in /tmp/test-flake/.git/1649gitlab # [ 326.923023] setup-gitlab-start[2919]: + git config user.name test1650gitlab # [ 326.929408] setup-gitlab-start[2919]: + git config user.email test@example.com1651gitlab # [ 326.936480] setup-gitlab-start[2919]: + cat1652gitlab # [ 326.942089] setup-gitlab-start[2919]: + git add flake.nix1653gitlab # [ 326.950918] setup-gitlab-start[2919]: + git commit -m 'initial commit'1654gitlab # [ 326.978425] setup-gitlab-start[3406]: [master (root-commit) f1d3076] initial commit1655gitlab # [ 326.982701] setup-gitlab-start[3406]: 1 file changed, 10 insertions(+)1656gitlab # [ 326.985577] setup-gitlab-start[3406]: create mode 100644 flake.nix1657gitlab # [ 326.989090] setup-gitlab-start[2919]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1658gitlab # [ 326.994818] setup-gitlab-start[2919]: + git push -u origin master1659gitlab # [ 327.306641] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 2671660gitlab # [ 327.507315] gitaly[894]: time="2026-08-16T17:31:44.321Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05T283TQ45CD3CP47PNQFFF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:44.301" grpc.time_ms=19.436 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1661gitlab # [ 327.545253] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2001662gitlab # [ 328.227676] gitaly[894]: time="2026-08-16T17:31:45.042Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:31:55.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:45.026" grpc.time_ms=15.275 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1663gitlab # [ 328.247218] sidekiq-cluster[3346]: {"severity":"INFO","time":"2026-08-16T17:31:45.033Z","message":"Starting cluster with 1 processes"}1664gitlab # [ 328.312892] gitaly[894]: time="2026-08-16T17:31:45.127Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:32:15.017" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:31:45.117" grpc.time_ms=10.14 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 328.380145] gitaly[894]: time="2026-08-16T17:31:45.194Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05T28AVPS49QVQRT7FCGSA4 duration_ms=347ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1666gitlab # [ 328.427694] gitaly[894]: time="2026-08-16T17:31:45.242Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05T28AVPS49QVQRT7FCGSA4 duration_ms=38ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1667gitlab # [ 328.440623] gitaly[894]: time="2026-08-16T17:31:45.243Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:44.844" grpc.time_ms=398.477 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1668gitlab # [ 328.481554] gitaly[894]: time="2026-08-16T17:31:45.296Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:45.293" grpc.time_ms=2.541 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1669gitlab # [ 328.518752] gitaly[894]: time="2026-08-16T17:31:45.332Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:45.331" grpc.time_ms=0.964 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1670gitlab # [ 328.548875] gitaly[894]: time="2026-08-16T17:31:45.363Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:45.362" grpc.time_ms=1.4 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1671gitlab # [ 328.703270] gitaly[894]: time="2026-08-16T17:31:45.517Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:31:55.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:45.504" grpc.time_ms=13.596 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 328.743968] gitaly[894]: time="2026-08-16T17:31:45.550Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:31:55.025" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:45.527" grpc.time_ms=22.294 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 328.777284] gitaly[894]: time="2026-08-16T17:31:45.566Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05T28AVPS49QVQRT7FCGSA4 duration_ms=171ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1674gitlab # [ 328.784431] gitaly[894]: time="2026-08-16T17:31:45.567Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:45.394" grpc.time_ms=173.316 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1675gitlab # [ 328.809052] gitaly[894]: time="2026-08-16T17:31:45.586Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 diskcache=65d94629-02b3-4e90-b269-022b164e6f90 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:44.734" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1676gitlab # [ 328.827969] setup-gitlab-start[3410]: To http://gitlab/root/test-flake.git1677gitlab # [ 328.830228] setup-gitlab-start[3410]: * [new branch] master -> master1678gitlab # [ 328.831642] setup-gitlab-start[3410]: branch 'master' set up to track 'origin/master'.1679gitlab # [ 328.833984] gitlab-workhorse[821]: time="2026-08-16T17:31:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521680gitlab # [ 328.836938] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:45 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12391681gitlab # [ 328.840515] systemd[1]: Finished setup-gitlab.service.1682gitlab # [ 328.841702] gitaly[894]: time="2026-08-16T17:31:45.586Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=265 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13455 command.oublock=32 command.real_time_ms=842 command.spawn_token_fork_ms=2 command.system_time_ms=169 command.user_time_ms=96 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:44.734" grpc.time_ms=851.672 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1683gitlab # [ 328.863777] systemd[1]: Starting nixbot CI service...1684gitlab: (finished: waiting for unit setup-gitlab.service, in 330.46 seconds)1685gitlab: waiting for unit nixbot.service1686gitlab # [ 330.088754] nixbot[3506]: {"ts": "2026-08-16T17:31:46.902Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1687gitlab # [ 330.113206] nixbot[3506]: {"ts": "2026-08-16T17:31:46.927Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1688gitlab # [ 330.131022] nixbot[3506]: {"ts": "2026-08-16T17:31:46.945Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1689gitlab # [ 330.137845] nixbot[3506]: {"ts": "2026-08-16T17:31:46.950Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1690gitlab # [ 330.144664] nixbot[3506]: {"ts": "2026-08-16T17:31:46.954Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1691gitlab # [ 330.151026] nixbot[3506]: {"ts": "2026-08-16T17:31:46.960Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1692gitlab # [ 330.157745] nixbot[3506]: {"ts": "2026-08-16T17:31:46.965Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1693gitlab # [ 330.164371] nixbot[3506]: {"ts": "2026-08-16T17:31:46.967Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1694gitlab # [ 330.170709] nixbot[3506]: {"ts": "2026-08-16T17:31:46.972Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1695gitlab # [ 330.177406] nixbot[3506]: {"ts": "2026-08-16T17:31:46.974Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1696gitlab # [ 330.184334] nixbot[3506]: {"ts": "2026-08-16T17:31:46.979Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1697gitlab # [ 330.191273] nixbot[3506]: {"ts": "2026-08-16T17:31:46.984Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1698gitlab # [ 330.197695] nixbot[3506]: {"ts": "2026-08-16T17:31:46.988Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1699gitlab # [ 330.204078] nixbot[3506]: {"ts": "2026-08-16T17:31:46.991Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1700gitlab # [ 330.210436] nixbot[3506]: {"ts": "2026-08-16T17:31:46.994Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1701gitlab # [ 330.216149] nixbot[3506]: {"ts": "2026-08-16T17:31:46.997Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1702gitlab # [ 330.221209] nixbot[3506]: {"ts": "2026-08-16T17:31:46.999Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1703gitlab # [ 330.225940] nixbot[3506]: {"ts": "2026-08-16T17:31:47.001Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1704gitlab # [ 330.230074] nixbot[3506]: {"ts": "2026-08-16T17:31:47.006Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1705gitlab # [ 330.234023] nixbot[3506]: {"ts": "2026-08-16T17:31:47.008Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1706gitlab # [ 330.240686] nixbot[3506]: {"ts": "2026-08-16T17:31:47.010Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1707gitlab # [ 330.244124] nixbot[3506]: {"ts": "2026-08-16T17:31:47.015Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1708gitlab # [ 330.247680] nixbot[3506]: {"ts": "2026-08-16T17:31:47.017Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1709gitlab # [ 330.251924] nixbot[3506]: {"ts": "2026-08-16T17:31:47.019Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1710gitlab # [ 330.256231] nixbot[3506]: {"ts": "2026-08-16T17:31:47.020Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1711gitlab # [ 330.582703] nixbot[3506]: INFO: Started server process [3506]1712gitlab # [ 330.585554] nixbot[3506]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1713gitlab # [ 330.606215] nixbot[3506]: INFO: ::ffff:127.0.0.1:59596 - "GET /health HTTP/1.1" 200 OK1714gitlab # [ 330.617581] systemd[1]: Started nixbot CI service.1715gitlab # [ 330.621691] systemd[1]: Reached target Multi-User System.1716gitlab # [ 330.624300] systemd[1]: Startup finished in 824ms (kernel) + 4.351s (initrd) + 5min 25.445s (userspace) = 5min 30.621s.1717gitlab # [ 330.898549] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:47 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2951718gitlab # [ 330.900955] nixbot[3506]: {"ts": "2026-08-16T17:31:47.715Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1719gitlab # [ 330.944111] nixbot[3506]: {"ts": "2026-08-16T17:31:47.758Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1720gitlab # [ 331.084825] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1331721gitlab # [ 331.093632] nixbot[3506]: {"ts": "2026-08-16T17:31:47.900Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1722gitlab # [ 331.101204] nixbot[3506]: {"ts": "2026-08-16T17:31:47.901Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1723gitlab: (finished: waiting for unit nixbot.service, in 1.09 seconds)1724gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1725gitlab # [ 331.159230] nixbot[3506]: INFO: ::ffff:127.0.0.1:43064 - "GET /health HTTP/1.1" 200 OK1726gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1727subtest: project discovered and webhook registered1728gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1729gitlab # [ 331.248647] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1591730gitlab # [ 331.250913] nixbot[3506]: {"ts": "2026-08-16T17:31:48.065Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1731gitlab # [ 331.394941] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1741732gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds)1733(finished: subtest: project discovered and webhook registered, in 0.23 seconds)1734subtest: push delivers the webhook1735gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1736gitlab # [ 331.491943] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 391737gitlab # [ 331.584280] gitaly[894]: time="2026-08-16T17:31:48.398Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2C6MF81GGVFYCR6H0VW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:48.387" grpc.time_ms=10.931 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1738gitlab # [ 331.598544] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 931739gitlab # Enumerating objects: 5, done.1740gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1741gitlab # Delta compression using up to 4 threads1742gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1743gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 272 bytes | 272.00 KiB/s, done.1744gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1745gitlab # [ 331.671624] nixbot[3506]: {"ts": "2026-08-16T17:31:48.486Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1746gitlab # [ 331.679062] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4121747gitlab # [ 331.778924] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 851748gitlab # [ 331.787399] nixbot[3506]: {"ts": "2026-08-16T17:31:48.597Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1749gitlab # [ 331.896240] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 1001750gitlab # [ 331.906275] nixbot[3506]: {"ts": "2026-08-16T17:31:48.709Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1751gitlab # [ 331.929847] gitaly[894]: time="2026-08-16T17:31:48.744Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:32:18.031" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:31:48.732" grpc.time_ms=12.335 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1752gitlab # [ 331.974694] gitaly[894]: time="2026-08-16T17:31:48.789Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CKEAYD3BBYM2X06MHSH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T17:32:18.677" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:48.778" grpc.time_ms=10.872 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 331.993929] gitaly[894]: time="2026-08-16T17:31:48.808Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CKEAYD3BBYM2X06MHSH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:32:18.705" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:31:48.806" grpc.time_ms=2.001 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 332.011684] gitaly[894]: time="2026-08-16T17:31:48.826Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CKEAYD3BBYM2X06MHSH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T17:31:58.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:31:48.815" grpc.time_ms=10.772 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755gitlab # [ 332.026059] gitaly[894]: time="2026-08-16T17:31:48.830Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05T2CAGEPZPN148AXVZQ3AY duration_ms=220ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/allowed"1756gitlab # [ 332.042835] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1381757gitlab # [ 332.045373] nixbot[3506]: {"ts": "2026-08-16T17:31:48.858Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1758gitlab # [ 332.077570] gitaly[894]: time="2026-08-16T17:31:48.892Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05T2CAGEPZPN148AXVZQ3AY duration_ms=61ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/pre_receive"1759gitlab # [ 332.082194] gitaly[894]: time="2026-08-16T17:31:48.892Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:48.609" grpc.time_ms=282.964 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1760gitlab # [ 332.115047] gitaly[894]: time="2026-08-16T17:31:48.929Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:48.929" grpc.time_ms=0.56 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1761gitlab # [ 332.150017] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1031762gitlab # [ 332.157049] nixbot[3506]: {"ts": "2026-08-16T17:31:48.965Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1763gitlab # [ 332.163204] nixbot[3506]: {"ts": "2026-08-16T17:31:48.969Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1764gitlab # [ 332.173399] gitaly[894]: time="2026-08-16T17:31:48.988Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:48.987" grpc.time_ms=0.876 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1765gitlab # [ 332.201640] gitaly[894]: time="2026-08-16T17:31:49.016Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:49.015" grpc.time_ms=0.494 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1766gitlab # [ 332.326027] gitaly[894]: time="2026-08-16T17:31:49.140Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05T2CAGEPZPN148AXVZQ3AY duration_ms=95ns method=POST pid=894 status=200 url="http://unix/api/v4/internal/post_receive"1767gitlab # [ 332.332310] gitaly[894]: time="2026-08-16T17:31:49.147Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:49.044" grpc.time_ms=99.091 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1768gitlab # [ 332.347336] gitaly[894]: time="2026-08-16T17:31:49.162Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY diskcache=2ac43332-4934-4026-b1b2-964398903bc5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:48.516" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1769gitlab # To http://gitlab/root/test-flake.git1770gitlab # [ 332.359799] gitaly[894]: time="2026-08-16T17:31:49.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=216 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13409 command.oublock=32 command.real_time_ms=633 command.spawn_token_fork_ms=4 command.system_time_ms=119 command.user_time_ms=97 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=604 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:48.516" grpc.time_ms=646.248 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1771gitlab # f1d3076..95b5b88 [ 332.375163] gitlab-workhorse[821]: time="2026-08-16T17:31:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521772gitlab # master -> master[ 332.377280] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:49 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7301773gitlab # 1774gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.99 seconds)1775gitlab: must succeed: git -C /tmp/test-flake rev-parse master1776gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1777gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1778gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.08 seconds)1779gitlab # [ 332.459841] gitaly[894]: time="2026-08-16T17:31:49.274Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CWQVHWVHVZAVTXRXXVV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.262" grpc.time_ms=12.258 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1780gitlab # [ 332.486486] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2591781gitlab # [ 332.491211] nixbot[3506]: INFO: ::ffff:127.0.0.1:43068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1782gitlab # [ 332.613251] gitaly[894]: time="2026-08-16T17:31:49.427Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2D4XMX17D08K3AFYCWYW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.407" pid=894 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1783gitlab # [ 332.629501] gitaly[894]: time="2026-08-16T17:31:49.427Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2D4XMX17D08K3AFYCWYW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.407" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1784gitlab # [ 332.647311] gitlab-workhorse[821]: time="2026-08-16T17:31:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131785gitlab # [ 332.649707] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1511786gitlab # [ 332.651909] gitaly[894]: time="2026-08-16T17:31:49.428Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2D4XMX17D08K3AFYCWYW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.407" grpc.time_ms=19.963 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1787gitlab # [ 332.758579] gitaly[894]: time="2026-08-16T17:31:49.573Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2D9XZC8AGR1Y5GY1DH79 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.539" pid=894 remote_ip="2001:db8:1::1" request_sha=b276a151f9e81b54c954f858a681a47d31a5c152 response_bytes=420 span.kind=server system=grpc1788gitlab # [ 332.789850] gitaly[894]: time="2026-08-16T17:31:49.573Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2D9XZC8AGR1Y5GY1DH79 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.539" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1789gitlab # [ 332.822003] gitlab-workhorse[821]: time="2026-08-16T17:31:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4201790gitlab # [ 332.826248] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 420 "" "git/2.55.0" 1361791gitlab # [ 332.830667] gitaly[894]: time="2026-08-16T17:31:49.574Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=25 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2D9XZC8AGR1Y5GY1DH79 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.539" grpc.time_ms=34.102 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1792gitlab # [ 332.975350] gitaly[894]: time="2026-08-16T17:31:49.790Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05T2DH9TRV6BKVMKJ7YBEC6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.771" grpc.time_ms=18.023 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1793gitlab # [ 333.015258] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:49 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1161794gitlab # [ 333.093928] gitaly[894]: time="2026-08-16T17:31:49.908Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2DN0NWGP4BZ951065JS1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.891" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1795gitlab # [ 333.124274] gitaly[894]: time="2026-08-16T17:31:49.908Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2DN0NWGP4BZ951065JS1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.891" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1796gitlab # [ 333.150173] gitlab-workhorse[821]: time="2026-08-16T17:31:49Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671797gitlab # [ 333.154081] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:49 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1171798gitlab # [ 333.157011] gitaly[894]: time="2026-08-16T17:31:49.909Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2DN0NWGP4BZ951065JS1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:49.891" grpc.time_ms=17.94 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1799gitlab # [ 333.278846] gitaly[894]: time="2026-08-16T17:31:50.093Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05T2DV59178ZT6G1321SY0J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:50.075" grpc.time_ms=17.271 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1800gitlab # [ 333.317842] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1111801gitlab # [ 333.401700] gitaly[894]: time="2026-08-16T17:31:50.216Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2DYRPR9S5J64DCZEPBT9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:50.184" pid=894 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1802gitlab # [ 333.433361] gitaly[894]: time="2026-08-16T17:31:50.216Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=23 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2DYRPR9S5J64DCZEPBT9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:50.184" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1803gitlab # [ 333.463366] gitlab-workhorse[821]: time="2026-08-16T17:31:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091804gitlab # [ 333.466888] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1131805gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1806gitlab # [ 333.472379] gitaly[894]: time="2026-08-16T17:31:50.217Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=23 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2DYRPR9S5J64DCZEPBT9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:50.184" grpc.time_ms=32.57 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1807gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1808gitlab # [ 333.540230] nixbot[3506]: INFO: ::ffff:127.0.0.1:43074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1809gitlab # [ 333.572590] gitaly[894]: time="2026-08-16T17:31:50.387Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:32:20.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:31:50.385" grpc.time_ms=1.221 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 333.657856] gitaly[894]: time="2026-08-16T17:31:50.471Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:32:20.152" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:50.452" grpc.time_ms=18.783 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 333.703356] gitaly[894]: time="2026-08-16T17:31:50.518Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:32:00.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:50.502" grpc.time_ms=15.729 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 333.754406] gitaly[894]: time="2026-08-16T17:31:50.567Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:32:00.201" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:50.551" grpc.time_ms=16.023 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 333.894210] gitaly[894]: time="2026-08-16T17:31:50.708Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:32:00.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:50.707" grpc.time_ms=0.551 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 333.927644] gitaly[894]: time="2026-08-16T17:31:50.738Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:32:00.022" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:50.723" grpc.time_ms=14.44 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 334.012404] gitaly[894]: time="2026-08-16T17:31:50.827Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:50.826" grpc.time_ms=0.811 pid=894 span.kind=server system=grpc1816gitlab # [ 334.066241] gitaly[894]: time="2026-08-16T17:31:50.881Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:31:50.879" grpc.time_ms=0.952 pid=894 span.kind=server system=grpc1817gitlab # [ 334.096178] gitaly[894]: time="2026-08-16T17:31:50.894Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF diskcache=f68e1077-13c0-463d-9cb2-d6986a9dca9f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:32:00.041" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:50.742" pid=894 ref=refs/keep-around/f1d3076aa9d75503284693a44993120775e11fd2 remote_ip="2001:db8:1::1" revision=f1d3076aa9d75503284693a44993120775e11fd2 span.kind=server system=grpc username=root1818gitlab # [ 334.119686] gitaly[894]: time="2026-08-16T17:31:50.911Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5159 command.oublock=8 command.real_time_ms=143 command.spawn_token_fork_ms=2 command.system_time_ms=69 command.user_time_ms=62 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:32:00.041" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:31:50.742" grpc.time_ms=167.978 pid=894 ref=refs/keep-around/f1d3076aa9d75503284693a44993120775e11fd2 remote_ip="2001:db8:1::1" revision=f1d3076aa9d75503284693a44993120775e11fd2 span.kind=server system=grpc username=root1819gitlab # [ 334.142256] gitaly[894]: time="2026-08-16T17:31:50.918Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:32:20.217" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:31:50.917" grpc.time_ms=0.675 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 334.491625] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 10241821gitlab # [ 334.494450] nixbot[3506]: {"ts": "2026-08-16T17:31:51.308Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 \"HTTP/1.1 201 Created\""}1822gitlab # [ 334.505326] nixbot[3506]: {"ts": "2026-08-16T17:31:51.320Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f1d3076aa9d7-0"}1823gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1824gitlab # [ 334.590218] nixbot[3506]: INFO: ::ffff:127.0.0.1:43080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1826gitlab # [ 334.618410] systemd[1]: Started Nix Daemon.1827gitlab # [ 334.724353] nix-daemon[3715]: accepted connection from pid 3706, user nixbot1828gitlab # [ 334.827649] nix-daemon[3715]: accepted connection from pid 3722, user nixbot1829gitlab # [ 334.850554] nixbot[3506]: {"ts": "2026-08-16T17:31:51.665Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f1d3076aa9d7-0", "argv0": "bwrap"}1830gitlab # [ 335.081890] nix-daemon[3715]: accepted connection from pid 3732, user nixbot1831gitlab # [ 335.161646] nix-daemon[3715]: accepted connection from pid 3742, user nixbot1832gitlab # [ 335.181909] nix-daemon[3715]: accepted connection from pid 3732, user nixbot1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1835gitlab # [ 335.646632] nixbot[3506]: INFO: ::ffff:127.0.0.1:43086 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1836gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1837gitlab # [ 336.700767] nixbot[3506]: INFO: ::ffff:127.0.0.1:43092 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1838gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1839gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1840gitlab # [ 337.755087] nixbot[3506]: INFO: ::ffff:127.0.0.1:43108 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1841gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1842gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1844gitlab # [ 338.810042] nixbot[3506]: INFO: ::ffff:127.0.0.1:43120 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1845gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1846gitlab # [ 339.862785] nixbot[3506]: INFO: ::ffff:127.0.0.1:43136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1847gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1848gitlab # [ 339.869518] gitaly[894]: time="2026-08-16T17:31:56.681Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2M8GQQYSEH5E743H7QAQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:32:26.578" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:31:56.679" grpc.time_ms=1.617 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 340.201079] gitaly[894]: time="2026-08-16T17:31:57.015Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2M8GQQYSEH5E743H7QAQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:32:06.187" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:56.998" grpc.time_ms=17.243 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850gitlab # [ 340.362432] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 6161851gitlab # [ 340.366231] nixbot[3506]: {"ts": "2026-08-16T17:31:57.178Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 \"HTTP/1.1 201 Created\""}1852gitlab # [ 340.434343] gitaly[894]: time="2026-08-16T17:31:57.249Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2MW3T367WGY6J4ZHWET1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:32:27.146" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:31:57.247" grpc.time_ms=1.177 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 340.476522] gitaly[894]: time="2026-08-16T17:31:57.291Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05T2MW3T367WGY6J4ZHWET1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:32:07.260" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:57.280" grpc.time_ms=10.503 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 340.537892] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1631855gitlab # [ 340.541068] nixbot[3506]: {"ts": "2026-08-16T17:31:57.353Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 \"HTTP/1.1 201 Created\""}1856gitlab # [ 340.608696] gitaly[894]: time="2026-08-16T17:31:57.423Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2N1S08JRHDHRP4Q5TF11 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:32:27.321" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:31:57.421" grpc.time_ms=1.266 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 340.655212] gitaly[894]: time="2026-08-16T17:31:57.469Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05T2N1S08JRHDHRP4Q5TF11 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:32:07.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:31:57.453" grpc.time_ms=16.09 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 340.753611] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1981859gitlab # [ 340.761032] nixbot[3506]: {"ts": "2026-08-16T17:31:57.569Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 \"HTTP/1.1 201 Created\""}1860gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1861gitlab # [ 340.909488] nix-daemon[3715]: accepted connection from pid 3782, user nixbot1862gitlab # [ 340.918536] nixbot[3506]: INFO: ::ffff:127.0.0.1:42830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1864gitlab # [ 341.106488] gitaly[894]: time="2026-08-16T17:31:57.920Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05T2NFKZ4ST60ZC20S1J3W0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:57.902" grpc.time_ms=17.88 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1865gitlab # [ 341.134043] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:57 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1091866gitlab # [ 341.264373] gitaly[894]: time="2026-08-16T17:31:58.078Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2NK4Z8Y86ZRX4YBCV51E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:58.058" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1867gitlab # [ 341.296406] gitaly[894]: time="2026-08-16T17:31:58.079Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2NK4Z8Y86ZRX4YBCV51E grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:58.058" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1868gitlab # [ 341.324536] gitlab-workhorse[821]: time="2026-08-16T17:31:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671869gitlab # [ 341.327628] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:31:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1561870gitlab # [ 341.330903] gitaly[894]: time="2026-08-16T17:31:58.080Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2NK4Z8Y86ZRX4YBCV51E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:31:58.058" grpc.time_ms=21.312 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc1871gitlab # [ 341.459704] nix-daemon[3715]: accepted connection from pid 3810, user nixbot1872gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1873gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.07 seconds)1874gitlab # [ 341.983929] nixbot[3506]: INFO: ::ffff:127.0.0.1:42836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1875gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1876gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1877gitlab # [ 343.037177] nixbot[3506]: INFO: ::ffff:127.0.0.1:42838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1878gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1879gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1880gitlab # [ 344.089608] nixbot[3506]: INFO: ::ffff:127.0.0.1:42840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1881gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1883gitlab # [ 345.142737] nixbot[3506]: INFO: ::ffff:127.0.0.1:42854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1884gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1885gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1886gitlab # [ 346.194290] nixbot[3506]: INFO: ::ffff:127.0.0.1:42860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1887gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1889gitlab # [ 347.247045] nixbot[3506]: INFO: ::ffff:127.0.0.1:42872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1891gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1892gitlab # [ 348.299554] nixbot[3506]: INFO: ::ffff:127.0.0.1:42874 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1894gitlab # [ 349.352219] nixbot[3506]: INFO: ::ffff:127.0.0.1:42888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1896gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1897gitlab # [ 350.407580] nixbot[3506]: INFO: ::ffff:127.0.0.1:42892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1898gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1899gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1900gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1901gitlab # [ 351.461906] nixbot[3506]: INFO: ::ffff:127.0.0.1:32968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1903gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1904gitlab # [ 352.513635] nixbot[3506]: INFO: ::ffff:127.0.0.1:32972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1905gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1906gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1907gitlab # [ 353.564815] nixbot[3506]: INFO: ::ffff:127.0.0.1:32986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1909gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1910gitlab # [ 354.616978] nixbot[3506]: INFO: ::ffff:127.0.0.1:32988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1912gitlab # [ 355.668661] nixbot[3506]: INFO: ::ffff:127.0.0.1:33002 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1913gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1914gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1915gitlab # [ 356.722135] nixbot[3506]: INFO: ::ffff:127.0.0.1:33006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1918gitlab # [ 357.775956] nixbot[3506]: INFO: ::ffff:127.0.0.1:33016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1920gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1921gitlab # [ 358.829642] nixbot[3506]: INFO: ::ffff:127.0.0.1:33018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1922gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1923gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1924gitlab # [ 359.883231] nixbot[3506]: INFO: ::ffff:127.0.0.1:33022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1925gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1927gitlab # [ 360.937634] nixbot[3506]: INFO: ::ffff:127.0.0.1:47288 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1930gitlab # [ 361.991603] nixbot[3506]: INFO: ::ffff:127.0.0.1:47296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1933gitlab # [ 363.045755] nixbot[3506]: INFO: ::ffff:127.0.0.1:47304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1937gitlab # [ 364.101034] nixbot[3506]: INFO: ::ffff:127.0.0.1:47306 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1939gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1940gitlab # [ 365.152580] nixbot[3506]: INFO: ::ffff:127.0.0.1:47316 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1942gitlab # [ 366.205637] nixbot[3506]: INFO: ::ffff:127.0.0.1:47320 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1944gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1945gitlab # [ 367.260352] nixbot[3506]: INFO: ::ffff:127.0.0.1:47336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1948gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1949gitlab # [ 368.315961] nixbot[3506]: INFO: ::ffff:127.0.0.1:47352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1950gitlab # [ 368.819534] sidekiq-cluster[3452]: 2026-08-16T17:32:25.633Z pid=3452 tid=yqc INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3452, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425971712}1951gitlab # [ 369.104316] sidekiq-cluster[3452]: W, [2026-08-16T17:32:25.918958 #3452] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1952gitlab # [ 369.241241] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:32:26.055Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1954gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1955gitlab # [ 369.368752] nixbot[3506]: INFO: ::ffff:127.0.0.1:47358 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1957gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1958gitlab # [ 370.421613] nixbot[3506]: INFO: ::ffff:127.0.0.1:47360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1960gitlab # [ 371.474697] nixbot[3506]: INFO: ::ffff:127.0.0.1:38106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1962gitlab # [ 372.176399] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:32:28.989Z","message":"GitLab reliable fetch activated!"}1963gitlab # [ 372.181333] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:32:28.990Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1964gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1965gitlab # [ 372.529828] nixbot[3506]: INFO: ::ffff:127.0.0.1:38120 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1966gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1967gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1968gitlab # [ 373.583974] nixbot[3506]: INFO: ::ffff:127.0.0.1:38132 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1969gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1970gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1971gitlab # [ 374.639180] nixbot[3506]: INFO: ::ffff:127.0.0.1:38136 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1972gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1973gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1974gitlab # [ 375.694071] nixbot[3506]: INFO: ::ffff:127.0.0.1:38138 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1975gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1976gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1978gitlab # [ 376.749641] nixbot[3506]: INFO: ::ffff:127.0.0.1:38154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1979gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1981gitlab # [ 377.803627] nixbot[3506]: INFO: ::ffff:127.0.0.1:38164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1982gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1984gitlab # [ 378.856076] nixbot[3506]: INFO: ::ffff:127.0.0.1:38178 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1985gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1986gitlab # [ 379.907649] nixbot[3506]: INFO: ::ffff:127.0.0.1:38188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1988gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1989gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1990gitlab # [ 380.962058] nixbot[3506]: INFO: ::ffff:127.0.0.1:38630 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)1993gitlab # [ 382.014839] nixbot[3506]: INFO: ::ffff:127.0.0.1:38642 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1995gitlab # [ 383.067522] nixbot[3506]: INFO: ::ffff:127.0.0.1:38650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1996gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'1998gitlab # [ 384.122174] nixbot[3506]: INFO: ::ffff:127.0.0.1:38654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK1999gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2002gitlab # [ 385.177004] nixbot[3506]: INFO: ::ffff:127.0.0.1:38670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2004gitlab # [ 386.229438] nixbot[3506]: INFO: ::ffff:127.0.0.1:38672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2005gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2007gitlab # [ 387.284600] nixbot[3506]: INFO: ::ffff:127.0.0.1:38684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2008gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2010gitlab # [ 388.338630] nixbot[3506]: INFO: ::ffff:127.0.0.1:38698 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2011gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2013gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2014gitlab # [ 389.393543] nixbot[3506]: INFO: ::ffff:127.0.0.1:38704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2016gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2017gitlab # [ 390.445550] nixbot[3506]: INFO: ::ffff:127.0.0.1:38708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2020gitlab # [ 391.498444] nixbot[3506]: INFO: ::ffff:127.0.0.1:32776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2023gitlab # [ 392.550776] nixbot[3506]: INFO: ::ffff:127.0.0.1:32786 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2025gitlab # [ 393.602468] nixbot[3506]: INFO: ::ffff:127.0.0.1:32790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2026gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2027gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2028gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2029gitlab # [ 394.657630] nixbot[3506]: INFO: ::ffff:127.0.0.1:32806 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2031gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2032gitlab # [ 395.710169] nixbot[3506]: INFO: ::ffff:127.0.0.1:32822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2034gitlab # [ 396.762928] nixbot[3506]: INFO: ::ffff:127.0.0.1:32828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2038gitlab # [ 397.818692] nixbot[3506]: INFO: ::ffff:127.0.0.1:32842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2040gitlab # [ 398.870859] nixbot[3506]: INFO: ::ffff:127.0.0.1:32856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2043gitlab # [ 399.925609] nixbot[3506]: INFO: ::ffff:127.0.0.1:32870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2044gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2045gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2046gitlab # [ 400.980310] nixbot[3506]: INFO: ::ffff:127.0.0.1:58648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2049gitlab # [ 402.034474] nixbot[3506]: INFO: ::ffff:127.0.0.1:58650 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2052gitlab # [ 403.088734] nixbot[3506]: INFO: ::ffff:127.0.0.1:58660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2054gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2055gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2056gitlab # [ 404.143184] nixbot[3506]: INFO: ::ffff:127.0.0.1:58676 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2057gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2058gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2059gitlab # [ 405.195436] nixbot[3506]: INFO: ::ffff:127.0.0.1:58678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2060gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2061gitlab # [ 406.248090] nixbot[3506]: INFO: ::ffff:127.0.0.1:58690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2062gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2063gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2065gitlab # [ 407.299392] nixbot[3506]: INFO: ::ffff:127.0.0.1:58700 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2066gitlab # [ 408.281467] postgres[4026]: [4026] ERROR: relation "table_without_models" does not exist2067gitlab # [ 408.281833] postgres[4026]: [4026] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2068gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2069gitlab # [ 408.351776] nixbot[3506]: INFO: ::ffff:127.0.0.1:58710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2070gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2071gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2072gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2073gitlab # [ 409.407704] nixbot[3506]: INFO: ::ffff:127.0.0.1:58724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2074gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2075gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2076gitlab # [ 410.460140] nixbot[3506]: INFO: ::ffff:127.0.0.1:58726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2077gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2078gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2079gitlab # [ 411.516463] nixbot[3506]: INFO: ::ffff:127.0.0.1:41208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2080gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2081gitlab # [ 412.569457] nixbot[3506]: INFO: ::ffff:127.0.0.1:41210 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2082gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2083gitlab # [ 413.116515] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:09.930Z","message":"Booted Rails 7.2.3.1 application in production environment"}2084gitlab # [ 413.122377] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:09.930Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2085gitlab # [ 413.128494] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:09.930Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2086gitlab # [ 413.133772] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:09.930Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2087gitlab # [ 413.139857] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:09.932Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2088gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2089gitlab # [ 413.624790] nixbot[3506]: INFO: ::ffff:127.0.0.1:41226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2090gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2091gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2092gitlab # [ 414.679494] nixbot[3506]: INFO: ::ffff:127.0.0.1:41228 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2093gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2094gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2095gitlab # [ 415.688540] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:12.501Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"79132bcb751e2739435aef49","created_at":"2026-08-16T17:31:42.217Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:42.274Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-79132bcb751e2739435aef49: start","job_status":"start","queue_duration_s":90.226999,"scheduling_latency_s":90.227048}2096gitlab # [ 415.735445] nixbot[3506]: INFO: ::ffff:127.0.0.1:41240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2097gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2098gitlab # [ 415.928379] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:12.742Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"79132bcb751e2739435aef49","created_at":"2026-08-16T17:31:42.217Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:42.274Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-79132bcb751e2739435aef49: done: 0.240815 sec","job_status":"done","queue_duration_s":90.226999,"scheduling_latency_s":90.227048,"redis_calls":23,"redis_duration_s":0.009353,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005876,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001968,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001509,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13665722,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.240815,"completed_at":"2026-08-16T17:33:12.742Z","load_balancing_strategy":"primary","db_duration_s":0.091783,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2099gitlab # [ 416.031553] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:12.744Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"143b84ff122d84a5eb60c42c","created_at":"2026-08-16T17:31:42.292Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:42.300Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-143b84ff122d84a5eb60c42c: start","job_status":"start","queue_duration_s":90.444583,"scheduling_latency_s":90.444609}2100gitlab # [ 416.077533] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:12.891Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"143b84ff122d84a5eb60c42c","created_at":"2026-08-16T17:31:42.292Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:42.300Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-143b84ff122d84a5eb60c42c: done: 0.14704 sec","job_status":"done","queue_duration_s":90.444583,"scheduling_latency_s":90.444609,"redis_calls":14,"redis_duration_s":0.004227,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000821,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002113,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001293,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11574928000000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.14704,"completed_at":"2026-08-16T17:33:12.891Z","load_balancing_strategy":"primary","db_duration_s":0.035455,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2101gitlab # [ 416.160866] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:12.893Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7c690b98974f6a23d209ff58","created_at":"2026-08-16T17:31:43.016Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:43.025Z","job_size_bytes":5,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7c690b98974f6a23d209ff58: start","job_status":"start","queue_duration_s":89.868861,"scheduling_latency_s":89.868883}2102gitlab # [ 416.280930] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:13.095Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7c690b98974f6a23d209ff58","created_at":"2026-08-16T17:31:43.016Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:43.025Z","job_size_bytes":5,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7c690b98974f6a23d209ff58: done: 0.201297 sec","job_status":"done","queue_duration_s":89.868861,"scheduling_latency_s":89.868883,"redis_calls":12,"redis_duration_s":0.003321,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000807,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001996,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000518,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.154957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004401,"duration_s":0.201297,"completed_at":"2026-08-16T17:33:13.095Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040082,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2103gitlab # [ 416.373288] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:13.096Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d1983d2d01b4542c7a35c0b1","created_at":"2026-08-16T17:31:43.063Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:43.070Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d1983d2d01b4542c7a35c0b1: start","job_status":"start","queue_duration_s":90.026704,"scheduling_latency_s":90.026723}2104gitlab # [ 416.544170] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:13.358Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d1983d2d01b4542c7a35c0b1","created_at":"2026-08-16T17:31:43.063Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:43.070Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d1983d2d01b4542c7a35c0b1: done: 0.261592 sec","job_status":"done","queue_duration_s":90.026704,"scheduling_latency_s":90.026723,"redis_calls":11,"redis_duration_s":0.003038,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.221,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.221,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.160269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059196,"duration_s":0.261592,"completed_at":"2026-08-16T17:33:13.358Z","load_balancing_strategy":"primary","db_duration_s":0.10456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2105gitlab # [ 416.644674] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:13.360Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3e3797350e3d3689d3aa99aa","created_at":"2026-08-16T17:31:43.074Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:43.081Z","job_size_bytes":89,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3e3797350e3d3689d3aa99aa: start","job_status":"start","queue_duration_s":90.279227,"scheduling_latency_s":90.279249}2106gitlab # [ 416.674829] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:13.407Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3e3797350e3d3689d3aa99aa","created_at":"2026-08-16T17:31:43.074Z","trace_propagation_headers":{"sentry-trace":"6ea25832535b408a807818366b5dac86-f3c3385450e34b7c","baggage":"sentry-trace_id=6ea25832535b408a807818366b5dac86,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T247BQ3C71EQ1SPTPMN1Y","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:43.081Z","job_size_bytes":89,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3e3797350e3d3689d3aa99aa: done: 0.047433 sec","job_status":"done","queue_duration_s":90.279227,"scheduling_latency_s":90.279249,"redis_calls":11,"redis_duration_s":0.003202,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000905,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005177,"duration_s":0.047433,"completed_at":"2026-08-16T17:33:13.407Z","load_balancing_strategy":"primary","db_duration_s":0.008977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2107gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2108gitlab # [ 416.730190] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:13.409Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f1d3076aa9d75503284693a44993120775e11fd2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f2edd70c934b703a804d7bec","created_at":"2026-08-16T17:31:45.439Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-aa571aa1083d4e3d","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:45.468Z","job_size_bytes":185,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f2edd70c934b703a804d7bec: start","job_status":"start","queue_duration_s":87.940902,"scheduling_latency_s":87.940924}2109gitlab # [ 416.748784] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:13.430Z","message":"changes: \"0000000000000000000000000000000000000000 f1d3076aa9d75503284693a44993120775e11fd2 refs/heads/master\\n\""}2110gitlab # [ 416.751527] gitaly[894]: time="2026-08-16T17:33:13.481Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:23.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:13.464" grpc.time_ms=17.047 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 416.766271] gitaly[894]: time="2026-08-16T17:33:13.496Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:33:23.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:13.487" grpc.time_ms=8.201 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 416.780272] gitaly[894]: time="2026-08-16T17:33:13.567Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:33:23.087" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:13.548" grpc.time_ms=18.807 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 416.795165] nixbot[3506]: INFO: ::ffff:127.0.0.1:41242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2114gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2115gitlab # [ 416.823839] gitaly[894]: time="2026-08-16T17:33:13.638Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:13.637" grpc.time_ms=0.751 pid=894 span.kind=server system=grpc2116gitlab # [ 416.873289] gitaly[894]: time="2026-08-16T17:33:13.688Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:13.687" grpc.time_ms=0.737 pid=894 span.kind=server system=grpc2117gitlab # [ 416.890189] gitaly[894]: time="2026-08-16T17:33:13.700Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 diskcache=4cf7ddcf-385e-4f92-862d-e963bfd62987 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:33:23.129" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:13.590" pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2118gitlab # [ 416.905658] gitaly[894]: time="2026-08-16T17:33:13.701Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=120 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5103 command.oublock=8 command.real_time_ms=104 command.spawn_token_fork_ms=1 command.system_time_ms=60 command.user_time_ms=60 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:33:23.129" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:13.590" grpc.time_ms=110.867 pid=894 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2119gitlab # [ 416.923198] gitaly[894]: time="2026-08-16T17:33:13.731Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:33:23.270" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:13.730" grpc.time_ms=0.373 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 416.949531] gitaly[894]: time="2026-08-16T17:33:13.764Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=861 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:33:23.278" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:13.739" grpc.time_ms=24.73 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 417.120636] gitaly[894]: time="2026-08-16T17:33:13.935Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T17:33:43.022" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:13.923" grpc.time_ms=12.009 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 417.177776] gitaly[894]: time="2026-08-16T17:33:13.992Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:33:23.011" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:13.991" grpc.time_ms=0.505 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 417.208341] gitaly[894]: time="2026-08-16T17:33:14.007Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:33:23.016" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:33:13.996" grpc.time_ms=10.039 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 417.239075] gitaly[894]: time="2026-08-16T17:33:14.053Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:24.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:14.036" grpc.time_ms=17.555 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2125gitlab # [ 417.269432] gitaly[894]: time="2026-08-16T17:33:14.082Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:24.035" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:14.065" grpc.time_ms=16.913 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2126gitlab # [ 417.320700] gitaly[894]: time="2026-08-16T17:33:14.135Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:33:44.006" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:14.106" grpc.time_ms=28.389 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2127gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2128gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2129gitlab # [ 417.858218] nixbot[3506]: INFO: ::ffff:127.0.0.1:41250 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2130gitlab # [ 418.073515] gitaly[894]: time="2026-08-16T17:33:14.887Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:33:24.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:14.884" grpc.time_ms=2.57 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2131gitlab # [ 418.119399] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:14.932Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f1d3076aa9d75503284693a44993120775e11fd2 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f2edd70c934b703a804d7bec","created_at":"2026-08-16T17:31:45.439Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-aa571aa1083d4e3d","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:45.468Z","job_size_bytes":185,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f2edd70c934b703a804d7bec: done: 1.522833 sec","job_status":"done","queue_duration_s":87.940902,"scheduling_latency_s":87.940924,"gitaly_calls":13,"gitaly_duration_s":0.323154,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.066748,"redis_read_bytes":2103,"redis_write_bytes":21749,"redis_cache_calls":15,"redis_cache_duration_s":0.007077,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008392,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002883,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7837,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005522,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.028096,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014778,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.326,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.373,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.045813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00091502,"exclusive_lock_hold_duration_s":0.039383480000000005,"duration_s":1.522833,"completed_at":"2026-08-16T17:33:14.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.15638,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2132gitlab # [ 418.214545] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:14.934Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f1d3076aa9d75503284693a44993120775e11fd2 95b5b88c7996170330c22dfac39ae3789732fb71 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f9f332aa0e06d8cc93e2d03b","created_at":"2026-08-16T17:31:49.099Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-4a83b747ffff407f","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:49.104Z","job_size_bytes":185,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f9f332aa0e06d8cc93e2d03b: start","job_status":"start","queue_duration_s":85.830281,"scheduling_latency_s":85.830307}2133gitlab # [ 418.232912] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:14.951Z","message":"changes: \"f1d3076aa9d75503284693a44993120775e11fd2 95b5b88c7996170330c22dfac39ae3789732fb71 refs/heads/master\\n\""}2134gitlab # [ 418.235298] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:15.017Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"91cab9fad661bdd1d8147b9d","created_at":"2026-08-16T17:33:15.014Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-5a9d28fa36554f62","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"ee407b87f791f985b79f0ec9","job_size_bytes":46,"pid":3452,"job_status":"deduplicated","message":"ProjectCacheWorker JID-91cab9fad661bdd1d8147b9d: deduplicated: until executing","deduplication.type":"until executing"}2135gitlab # [ 418.250317] gitaly[894]: time="2026-08-16T17:33:14.989Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:24.092" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:14.973" grpc.time_ms=16.325 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2136gitlab # [ 418.263462] gitaly[894]: time="2026-08-16T17:33:15.009Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:33:24.115" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:14.996" grpc.time_ms=13.175 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2137gitlab # [ 418.277031] gitaly[894]: time="2026-08-16T17:33:15.056Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:33:25.013" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:15.043" grpc.time_ms=12.465 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 418.291451] gitaly[894]: time="2026-08-16T17:33:15.083Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T17:33:45.064" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:15.064" grpc.time_ms=18.886 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 418.307253] gitaly[894]: time="2026-08-16T17:33:15.114Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:33:25.074" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:33:15.104" grpc.time_ms=9.83 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2140gitlab # [ 418.332982] gitaly[894]: time="2026-08-16T17:33:15.147Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:25.100" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:15.131" grpc.time_ms=16.411 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 418.515899] gitaly[894]: time="2026-08-16T17:33:15.330Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:33:25.297" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:15.328" grpc.time_ms=2.261 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2142gitlab # [ 418.563260] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:15.376Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f1d3076aa9d75503284693a44993120775e11fd2 95b5b88c7996170330c22dfac39ae3789732fb71 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"f9f332aa0e06d8cc93e2d03b","created_at":"2026-08-16T17:31:49.099Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-4a83b747ffff407f","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:31:49.104Z","job_size_bytes":185,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-f9f332aa0e06d8cc93e2d03b: done: 0.441786 sec","job_status":"done","queue_duration_s":85.830281,"scheduling_latency_s":85.830307,"gitaly_calls":7,"gitaly_duration_s":0.117162,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.03403,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.003749,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001668,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005189,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.009689,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013735,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.044,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.044,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.277926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089244,"exclusive_lock_hold_duration_s":0.02747806,"duration_s":0.441786,"completed_at":"2026-08-16T17:33:15.376Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043043,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2143gitlab # [ 418.654771] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:15.380Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1a8401874fb867fe5b5998aa","created_at":"2026-08-16T17:31:50.926Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-43c8c7826d6b41b9","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:50.943Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1a8401874fb867fe5b5998aa: start","job_status":"start","queue_duration_s":84.437103,"scheduling_latency_s":84.437147}2144gitlab # [ 418.733393] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:15.547Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1a8401874fb867fe5b5998aa","created_at":"2026-08-16T17:31:50.926Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-43c8c7826d6b41b9","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:50.943Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1a8401874fb867fe5b5998aa: done: 0.166829 sec","job_status":"done","queue_duration_s":84.437103,"scheduling_latency_s":84.437147,"redis_calls":16,"redis_duration_s":0.006216,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003031,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002425,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089442,"duration_s":0.166829,"completed_at":"2026-08-16T17:33:15.547Z","load_balancing_strategy":"primary","db_duration_s":0.038184,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2145gitlab # [ 418.826337] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:15.550Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2f7eda433394334c1c998fc3","created_at":"2026-08-16T17:31:50.945Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-43c8c7826d6b41b9","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:50.957Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2f7eda433394334c1c998fc3: start","job_status":"start","queue_duration_s":84.593117,"scheduling_latency_s":84.593147}2146gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2147gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2148gitlab # [ 418.921106] nixbot[3506]: INFO: ::ffff:127.0.0.1:41260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2149gitlab # [ 419.036243] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:15.850Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2f7eda433394334c1c998fc3","created_at":"2026-08-16T17:31:50.945Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-43c8c7826d6b41b9","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:50.957Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2f7eda433394334c1c998fc3: done: 0.30033 sec","job_status":"done","queue_duration_s":84.593117,"scheduling_latency_s":84.593147,"redis_calls":21,"redis_duration_s":0.00733,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003659,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001734,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.236327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055082,"duration_s":0.30033,"completed_at":"2026-08-16T17:33:15.850Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2150gitlab # [ 419.153036] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:15.852Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"041ee9906a104ea1511f8686","created_at":"2026-08-16T17:31:51.251Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-43c8c7826d6b41b9","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:51.262Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-041ee9906a104ea1511f8686: start","job_status":"start","queue_duration_s":84.590611,"scheduling_latency_s":84.590633}2151gitlab # [ 419.283655] gitaly[894]: time="2026-08-16T17:33:16.097Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:16.096" grpc.time_ms=0.83 pid=894 span.kind=server system=grpc2152gitlab # [ 419.331787] gitaly[894]: time="2026-08-16T17:33:16.146Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:16.145" grpc.time_ms=0.828 pid=894 span.kind=server system=grpc2153gitlab # [ 419.378258] gitaly[894]: time="2026-08-16T17:33:16.193Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:16.192" grpc.time_ms=0.823 pid=894 span.kind=server system=grpc2154gitlab # [ 419.407654] gitaly[894]: time="2026-08-16T17:33:16.205Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF diskcache=faaca13d-59e7-4937-86d7-99d8205f0796 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:46.040" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:16.041" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 419.429472] gitaly[894]: time="2026-08-16T17:33:16.205Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=186 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7408 command.oublock=0 command.real_time_ms=157 command.spawn_token_fork_ms=1 command.system_time_ms=112 command.user_time_ms=74 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:46.040" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:16.041" grpc.time_ms=164.145 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 419.590118] gitaly[894]: time="2026-08-16T17:33:16.404Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:33:46.402" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:16.403" grpc.time_ms=1.582 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 419.649712] gitaly[894]: time="2026-08-16T17:33:16.464Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2E490W61FEBFN5HGJBHF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:46.462" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:16.462" grpc.time_ms=1.348 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2158gitlab # [ 419.686611] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.490Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"041ee9906a104ea1511f8686","created_at":"2026-08-16T17:31:51.251Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-43c8c7826d6b41b9","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:31:51.262Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-041ee9906a104ea1511f8686: done: 0.63758 sec","job_status":"done","queue_duration_s":84.590611,"scheduling_latency_s":84.590633,"gitaly_calls":3,"gitaly_duration_s":0.176711,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.036889,"redis_read_bytes":457,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001701,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002429,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.013287,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005333,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.007494,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000796,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000814,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003334,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.033,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.037,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.048,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.337462,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.56070178,"duration_s":0.63758,"completed_at":"2026-08-16T17:33:16.490Z","load_balancing_strategy":"primary","db_duration_s":0.110752,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 419.782640] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.492Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ee407b87f791f985b79f0ec9","created_at":"2026-08-16T17:33:13.498Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:13.516Z","job_size_bytes":46,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ee407b87f791f985b79f0ec9: start","job_status":"start","queue_duration_s":2.975649,"scheduling_latency_s":2.975671}2160gitlab # [ 419.800583] gitaly[894]: time="2026-08-16T17:33:16.589Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T23:33:16.580" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:16.580" grpc.time_ms=8.238 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 419.811531] gitaly[894]: time="2026-08-16T17:33:16.624Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:33:46.606" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:16.607" grpc.time_ms=16.561 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2163gitlab # [ 419.867723] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.681Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ee407b87f791f985b79f0ec9","created_at":"2026-08-16T17:33:13.498Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:13.516Z","job_size_bytes":46,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ee407b87f791f985b79f0ec9: done: 0.189137 sec","job_status":"done","queue_duration_s":2.975649,"scheduling_latency_s":2.975671,"gitaly_calls":2,"gitaly_duration_s":0.032441,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011932,"redis_read_bytes":69,"redis_write_bytes":4885,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002097,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000937,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002447,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005365,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.127459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061448,"duration_s":0.189137,"completed_at":"2026-08-16T17:33:16.681Z","load_balancing_strategy":"primary","db_duration_s":0.019081,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2164gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2165gitlab # [ 419.963723] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.684Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5adc94a17ff64812bdd5c557","created_at":"2026-08-16T17:33:13.537Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:13.543Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5adc94a17ff64812bdd5c557: start","job_status":"start","queue_duration_s":3.141072,"scheduling_latency_s":3.141104}2166gitlab # [ 419.988262] gitaly[894]: time="2026-08-16T17:33:16.768Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 diskcache=dba99a0f-c54e-483d-b99c-e786d510f803 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:33:16.722" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:16.723" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 420.001673] nixbot[3506]: INFO: ::ffff:127.0.0.1:41266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2168gitlab # [ 420.004265] gitaly[894]: time="2026-08-16T17:33:16.769Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=55 command.spawn_token_fork_ms=4 command.system_time_ms=25 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:33:16.722" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:16.723" grpc.time_ms=45.428 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 420.038464] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.851Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5adc94a17ff64812bdd5c557","created_at":"2026-08-16T17:33:13.537Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:13.543Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5adc94a17ff64812bdd5c557: done: 0.166938 sec","job_status":"done","queue_duration_s":3.141072,"scheduling_latency_s":3.141104,"gitaly_calls":1,"gitaly_duration_s":0.049133,"redis_calls":15,"redis_duration_s":0.0056489999999999995,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000879,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12147914,"duration_s":0.166938,"completed_at":"2026-08-16T17:33:16.851Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2170gitlab # [ 420.096139] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.855Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"219f4160a3668edbb22b64b3","created_at":"2026-08-16T17:33:13.722Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:13.726Z","job_size_bytes":23,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-219f4160a3668edbb22b64b3: start","job_status":"start","queue_duration_s":3.128773,"scheduling_latency_s":3.128813}2171gitlab # [ 420.111275] gitaly[894]: time="2026-08-16T17:33:16.922Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:33:46.805" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:16.906" grpc.time_ms=16.4 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 420.125454] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.938Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"219f4160a3668edbb22b64b3","created_at":"2026-08-16T17:33:13.722Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:13.726Z","job_size_bytes":23,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-219f4160a3668edbb22b64b3: done: 0.083243 sec","job_status":"done","queue_duration_s":3.128773,"scheduling_latency_s":3.128813,"gitaly_calls":1,"gitaly_duration_s":0.019735,"redis_calls":16,"redis_duration_s":0.005558,"redis_read_bytes":52,"redis_write_bytes":2045,"redis_queues_calls":1,"redis_queues_duration_s":0.000447,"redis_queues_read_bytes":1,"redis_queues_write_bytes":976,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001751,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002329,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.083243,"completed_at":"2026-08-16T17:33:16.938Z","load_balancing_strategy":"primary","db_duration_s":0.005004,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2173gitlab # [ 420.170815] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:16.940Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ea94e97d239fc0964ff57239","created_at":"2026-08-16T17:33:14.577Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77a0f9460efd806bdfee9cd54837a69549bde63d678f1688c9ce4bbc05b24cb5","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:14.588Z","job_size_bytes":467,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ea94e97d239fc0964ff57239: start","job_status":"start","queue_duration_s":2.35194,"scheduling_latency_s":2.351969}2174gitlab # [ 420.187929] gitaly[894]: time="2026-08-16T17:33:16.981Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:46.880" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:16.980" grpc.time_ms=0.881 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2175gitlab # [ 420.200538] gitaly[894]: time="2026-08-16T17:33:17.001Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:33:26.104" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:16.985" grpc.time_ms=15.866 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2176gitlab # [ 420.396204] gitaly[894]: time="2026-08-16T17:33:17.209Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:33:47.208" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:17.208" grpc.time_ms=1.338 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 420.433434] gitaly[894]: time="2026-08-16T17:33:17.218Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=29 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:33:47.213" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:17.214" grpc.time_ms=4.347 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2178gitlab # [ 420.518215] gitaly[894]: time="2026-08-16T17:33:17.332Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:27.286" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:17.316" grpc.time_ms=16.093 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2180gitlab # [ 421.046404] nixbot[3506]: INFO: ::ffff:127.0.0.1:37614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2181gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.06 seconds)2182gitlab # [ 421.282454] gitaly[894]: time="2026-08-16T17:33:18.097Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=878 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:33:48.069" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:18.070" grpc.time_ms=26.816 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 421.312965] gitaly[894]: time="2026-08-16T17:33:18.127Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T28AVPS49QVQRT7FCGSA4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:33:48.102" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:18.102" grpc.time_ms=24.619 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 421.375934] sidekiq-cluster[3452]: {"severity":"WARN","time":"2026-08-16T17:33:18.189Z","class":"CreatePipelineWorker","correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"f1d3076aa9d75503284693a44993120775e11fd2","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f1d3076aa9d75503284693a44993120775e11fd2","ref":"refs/heads/master"},"retry":0}2185gitlab # [ 421.392688] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:18.206Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ea94e97d239fc0964ff57239","created_at":"2026-08-16T17:33:14.577Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77a0f9460efd806bdfee9cd54837a69549bde63d678f1688c9ce4bbc05b24cb5","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:14.588Z","job_size_bytes":467,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ea94e97d239fc0964ff57239: done: 1.265566 sec","job_status":"done","queue_duration_s":2.35194,"scheduling_latency_s":2.351969,"gitaly_calls":7,"gitaly_duration_s":0.1118,"redis_calls":51,"redis_duration_s":0.01334,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.001114,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005756,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002025,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00275,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001695,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.072157,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077418,"duration_s":1.265566,"completed_at":"2026-08-16T17:33:18.206Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08289,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2186gitlab # [ 421.465078] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:18.209Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"4860885a-2c4a-4ea1-8dc6-24fbfdfa4d96\"}"],"class":"WebHookWorker","jid":"e8a1fbbcfd932a2c4bc6c704","created_at":"2026-08-16T17:33:14.842Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ee4451f9b088d56a33cb2b19314d35fd9cd978cfbd2d2ed4ca5fda6b353aef52","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:14.848Z","job_size_bytes":1751,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e8a1fbbcfd932a2c4bc6c704: start","job_status":"start","queue_duration_s":3.360887,"scheduling_latency_s":3.360924}2187gitlab # [ 421.602177] nixbot[3506]: INFO: ::ffff:127.0.0.1:37622 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2188gitlab # [ 421.643142] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:18.456Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"4860885a-2c4a-4ea1-8dc6-24fbfdfa4d96\"}"],"class":"WebHookWorker","jid":"e8a1fbbcfd932a2c4bc6c704","created_at":"2026-08-16T17:33:14.842Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-a34fa125e5bb48df","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ee4451f9b088d56a33cb2b19314d35fd9cd978cfbd2d2ed4ca5fda6b353aef52","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:14.848Z","job_size_bytes":1751,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e8a1fbbcfd932a2c4bc6c704: done: 0.247137 sec","job_status":"done","queue_duration_s":3.360887,"scheduling_latency_s":3.360924,"redis_calls":19,"redis_duration_s":0.0066890000000000005,"redis_read_bytes":32,"redis_write_bytes":5365,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001696,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000822,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002794,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001377,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09232195999999249,"cpu_s":0.131422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00158076,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.247137,"completed_at":"2026-08-16T17:33:18.456Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2189gitlab # [ 421.761869] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:18.460Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1c69f0890d88bd916e6f1a98","created_at":"2026-08-16T17:33:15.030Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-5a9d28fa36554f62","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5adc94a17ff64812bdd5c557","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:15.035Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1c69f0890d88bd916e6f1a98: start","job_status":"start","queue_duration_s":3.424154,"scheduling_latency_s":3.42419}2190gitlab # [ 421.790708] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:18.538Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"1c69f0890d88bd916e6f1a98","created_at":"2026-08-16T17:33:15.030Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-5a9d28fa36554f62","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5adc94a17ff64812bdd5c557","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:15.035Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-1c69f0890d88bd916e6f1a98: done: 0.078787 sec","job_status":"done","queue_duration_s":3.424154,"scheduling_latency_s":3.42419,"gitaly_calls":1,"gitaly_duration_s":0.0185,"redis_calls":12,"redis_duration_s":0.004316,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000957,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001655,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.044619,"duration_s":0.078787,"completed_at":"2026-08-16T17:33:18.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2191gitlab # [ 421.844148] gitaly[894]: time="2026-08-16T17:33:18.508Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY diskcache=6c7c2056-aa55-4a45-bbe2-22266e90c2aa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:33:18.493" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:18.494" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2192gitlab # [ 421.853721] gitaly[894]: time="2026-08-16T17:33:18.509Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:33:18.493" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:18.494" grpc.time_ms=14.082 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2193gitlab # [ 421.867077] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:18.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c49811328cf2403e26413e57","created_at":"2026-08-16T17:33:15.254Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-5a9d28fa36554f62","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f662ebc63b0bb47ea24c05b28e07e0126b3ee0c1985c5c48118919fc9989b030","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:15.260Z","job_size_bytes":467,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c49811328cf2403e26413e57: start","job_status":"start","queue_duration_s":3.281128,"scheduling_latency_s":3.281154}2194gitlab # [ 421.884826] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1662195gitlab # [ 421.886881] gitaly[894]: time="2026-08-16T17:33:18.584Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:48.579" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:18.579" grpc.time_ms=4.082 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2196gitlab # [ 421.899218] gitaly[894]: time="2026-08-16T17:33:18.602Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:33:28.007" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:18.587" grpc.time_ms=14.081 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 421.912282] gitaly[894]: time="2026-08-16T17:33:18.633Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5483WC5VB21TCKMDHWN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:18.621" grpc.time_ms=12.528 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2198gitlab # [ 421.925307] gitaly[894]: time="2026-08-16T17:33:18.662Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:33:48.661" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:18.661" grpc.time_ms=0.985 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2199gitlab # [ 421.937940] gitaly[894]: time="2026-08-16T17:33:18.669Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=34 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:33:48.666" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:18.666" grpc.time_ms=2.731 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2200gitlab # [ 421.954702] gitaly[894]: time="2026-08-16T17:33:18.713Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:28.122" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:18.703" grpc.time_ms=9.561 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2201gitlab # [ 421.967921] gitaly[894]: time="2026-08-16T17:33:18.766Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T54DF8B4623FS4H5B872H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:18.751" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2202gitlab # [ 421.978262] gitlab-workhorse[821]: time="2026-08-16T17:33:18Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672203gitlab # [ 421.980058] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:18 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1282204gitlab # [ 421.981926] gitaly[894]: time="2026-08-16T17:33:18.766Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05T54DF8B4623FS4H5B872H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:18.751" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2205gitlab # [ 421.995013] gitaly[894]: time="2026-08-16T17:33:18.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05T54DF8B4623FS4H5B872H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:18.751" grpc.time_ms=15.441 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2206gitlab # [ 422.009713] nixbot[3506]: {"ts": "2026-08-16T17:33:18.818Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2207gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2208gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.07 seconds)2209gitlab # [ 422.114644] nixbot[3506]: INFO: ::ffff:127.0.0.1:37626 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2210gitlab # [ 422.379890] gitaly[894]: time="2026-08-16T17:33:19.194Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:49.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:19.193" grpc.time_ms=1.257 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2211gitlab # [ 422.586225] gitaly[894]: time="2026-08-16T17:33:19.400Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:33:49.373" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:19.373" grpc.time_ms=26.931 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2212gitlab # [ 422.611779] gitaly[894]: time="2026-08-16T17:33:19.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:29.067" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:19.417" grpc.time_ms=8.682 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2213gitlab # [ 422.625648] gitaly[894]: time="2026-08-16T17:33:19.428Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05T2CAGEPZPN148AXVZQ3AY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:33:49.406" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:19.407" grpc.time_ms=21.343 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2214gitlab # [ 422.642894] sidekiq-cluster[3452]: {"severity":"WARN","time":"2026-08-16T17:33:19.456Z","class":"CreatePipelineWorker","correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"f1d3076aa9d75503284693a44993120775e11fd2","after":"95b5b88c7996170330c22dfac39ae3789732fb71","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"95b5b88c7996170330c22dfac39ae3789732fb71","ref":"refs/heads/master"},"retry":0}2215gitlab # [ 422.656721] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c49811328cf2403e26413e57","created_at":"2026-08-16T17:33:15.254Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-5a9d28fa36554f62","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f662ebc63b0bb47ea24c05b28e07e0126b3ee0c1985c5c48118919fc9989b030","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:15.260Z","job_size_bytes":467,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c49811328cf2403e26413e57: done: 0.929211 sec","job_status":"done","queue_duration_s":3.281128,"scheduling_latency_s":3.281154,"gitaly_calls":7,"gitaly_duration_s":0.10488,"redis_calls":33,"redis_duration_s":0.008459999999999999,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000785,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002342,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003191,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002142,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.789818,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.929211,"completed_at":"2026-08-16T17:33:19.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033188,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2216gitlab # [ 422.704256] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.475Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"1621404d-b77f-4965-a17a-e44c031b5a84\"}"],"class":"WebHookWorker","jid":"7fbefa875b9f3c9313ab422f","created_at":"2026-08-16T17:33:15.293Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-5a9d28fa36554f62","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3764e7d3c6678e4877afd0a53afe3078155f71a5e122c539fc457410c86a5990","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:15.299Z","job_size_bytes":1749,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7fbefa875b9f3c9313ab422f: start","job_status":"start","queue_duration_s":4.176135,"scheduling_latency_s":4.176182}2217gitlab # [ 422.722008] nixbot[3506]: INFO: ::ffff:127.0.0.1:37638 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2218gitlab # [ 422.730869] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.545Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"1621404d-b77f-4965-a17a-e44c031b5a84\"}"],"class":"WebHookWorker","jid":"7fbefa875b9f3c9313ab422f","created_at":"2026-08-16T17:33:15.293Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-5a9d28fa36554f62","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3764e7d3c6678e4877afd0a53afe3078155f71a5e122c539fc457410c86a5990","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:15.299Z","job_size_bytes":1749,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-7fbefa875b9f3c9313ab422f: done: 0.07007 sec","job_status":"done","queue_duration_s":4.176135,"scheduling_latency_s":4.176182,"redis_calls":14,"redis_duration_s":0.007047,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.002281,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003239,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001527,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.010830859999998665,"cpu_s":0.043816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.07007,"completed_at":"2026-08-16T17:33:19.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2219gitlab # [ 422.779773] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c69e764fc8f41ac680a6210b","created_at":"2026-08-16T17:33:16.018Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.024Z","job_size_bytes":23,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c69e764fc8f41ac680a6210b: start","job_status":"start","queue_duration_s":3.524584,"scheduling_latency_s":3.524616}2220gitlab # [ 422.852681] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.666Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"c69e764fc8f41ac680a6210b","created_at":"2026-08-16T17:33:16.018Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.024Z","job_size_bytes":23,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-c69e764fc8f41ac680a6210b: done: 0.117452 sec","job_status":"done","queue_duration_s":3.524584,"scheduling_latency_s":3.524616,"redis_calls":10,"redis_duration_s":0.003262,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028172,"duration_s":0.117452,"completed_at":"2026-08-16T17:33:19.666Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019234,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2221gitlab # [ 422.908761] gitaly[894]: time="2026-08-16T17:33:19.668Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T55ATJXV4Y0XAJK39X8JJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.656" grpc.time_ms=11.276 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2222gitlab # [ 422.922156] nixbot[3506]: {"ts": "2026-08-16T17:33:19.672Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 \"HTTP/1.1 201 Created\""}2223gitlab # [ 422.925225] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 8322224gitlab # [ 422.927647] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 892225gitlab # [ 422.929841] gitlab-workhorse[821]: time="2026-08-16T17:33:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672226gitlab # [ 422.931618] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.669Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbc40fc392fd1bff9cbdc8d1","created_at":"2026-08-16T17:33:16.215Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.225Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbc40fc392fd1bff9cbdc8d1: start","job_status":"start","queue_duration_s":3.443329,"scheduling_latency_s":3.44335}2227gitlab # [ 422.949037] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.708Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cbc40fc392fd1bff9cbdc8d1","created_at":"2026-08-16T17:33:16.215Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.225Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cbc40fc392fd1bff9cbdc8d1: done: 0.039702 sec","job_status":"done","queue_duration_s":3.443329,"scheduling_latency_s":3.44335,"redis_calls":10,"redis_duration_s":0.002132,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000803,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030782,"duration_s":0.039702,"completed_at":"2026-08-16T17:33:19.708Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2228gitlab # [ 422.995342] gitaly[894]: time="2026-08-16T17:33:19.739Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T55DP6036RK98W1S2MJAB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.729" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2229gitlab # [ 423.006372] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 692230gitlab # [ 423.008323] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.710Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fefe7172fc226af83f5b20dd","created_at":"2026-08-16T17:33:16.254Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.264Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fefe7172fc226af83f5b20dd: start","job_status":"start","queue_duration_s":3.445883,"scheduling_latency_s":3.445902}2231gitlab # [ 423.024258] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"fefe7172fc226af83f5b20dd","created_at":"2026-08-16T17:33:16.254Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.264Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-fefe7172fc226af83f5b20dd: done: 0.044987 sec","job_status":"done","queue_duration_s":3.445883,"scheduling_latency_s":3.445902,"redis_calls":10,"redis_duration_s":0.0050030000000000005,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00083,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023098,"duration_s":0.044987,"completed_at":"2026-08-16T17:33:19.755Z","load_balancing_strategy":"primary","db_duration_s":0.00711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2232gitlab # [ 423.069691] gitaly[894]: time="2026-08-16T17:33:19.739Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55DP6036RK98W1S2MJAB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.729" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2233gitlab # [ 423.083423] nix-daemon[3715]: accepted connection from pid 4264, user nixbot2234gitlab # [ 423.084446] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"15879e3787ce4a60c9992a1e","created_at":"2026-08-16T17:33:16.294Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.303Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-15879e3787ce4a60c9992a1e: start","job_status":"start","queue_duration_s":3.454155,"scheduling_latency_s":3.454171}2235gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2236gitlab # [ 423.099970] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"15879e3787ce4a60c9992a1e","created_at":"2026-08-16T17:33:16.294Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.303Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-15879e3787ce4a60c9992a1e: done: 0.055209 sec","job_status":"done","queue_duration_s":3.454155,"scheduling_latency_s":3.454171,"redis_calls":13,"redis_duration_s":0.012317,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000924,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00638,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000624,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004343,"duration_s":0.055209,"completed_at":"2026-08-16T17:33:19.813Z","load_balancing_strategy":"primary","db_duration_s":0.004656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2237gitlab # [ 423.144703] gitaly[894]: time="2026-08-16T17:33:19.739Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55DP6036RK98W1S2MJAB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.729" grpc.time_ms=9.43 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2238gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.05 seconds)2239gitlab # [ 423.159641] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.814Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a5fab4543d4f2edc06f889b5","created_at":"2026-08-16T17:33:16.305Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.313Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a5fab4543d4f2edc06f889b5: start","job_status":"start","queue_duration_s":3.501028,"scheduling_latency_s":3.501046}2240gitlab # [ 423.176882] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.853Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a5fab4543d4f2edc06f889b5","created_at":"2026-08-16T17:33:16.305Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.313Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a5fab4543d4f2edc06f889b5: done: 0.038927 sec","job_status":"done","queue_duration_s":3.501028,"scheduling_latency_s":3.501046,"redis_calls":10,"redis_duration_s":0.004214,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000571,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101088,"duration_s":0.038927,"completed_at":"2026-08-16T17:33:19.853Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2241gitlab # [ 423.222388] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 802242gitlab # [ 423.224476] gitlab-workhorse[821]: time="2026-08-16T17:33:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672243gitlab # [ 423.226268] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 622244gitlab # [ 423.228133] gitaly[894]: time="2026-08-16T17:33:19.843Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55DVTSXFWFVDS24CT50J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:49.741" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:19.841" grpc.time_ms=1.37 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 423.240534] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.854Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4de4276067fed75e941995ee","created_at":"2026-08-16T17:33:16.314Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.325Z","job_size_bytes":19,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4de4276067fed75e941995ee: start","job_status":"start","queue_duration_s":3.52934,"scheduling_latency_s":3.529357}2246gitlab # [ 423.256836] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.891Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"4de4276067fed75e941995ee","created_at":"2026-08-16T17:33:16.314Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.325Z","job_size_bytes":19,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-4de4276067fed75e941995ee: done: 0.036605 sec","job_status":"done","queue_duration_s":3.52934,"scheduling_latency_s":3.529357,"redis_calls":11,"redis_duration_s":0.00229,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000934,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028246,"duration_s":0.036605,"completed_at":"2026-08-16T17:33:19.891Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2247gitlab # [ 423.301097] nixbot[3506]: INFO: ::ffff:127.0.0.1:37654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2248gitlab # [ 423.302986] nixbot[3506]: {"ts": "2026-08-16T17:33:20.060Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 \"HTTP/1.1 201 Created\""}2249gitlab # [ 423.305854] gitaly[894]: time="2026-08-16T17:33:19.905Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=7 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05T55JGDGDZMHV1TQ0XTMZJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.892" grpc.time_ms=12.927 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2250gitlab # [ 423.319160] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.892Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4f062fb1d0530d0f8ab89288","created_at":"2026-08-16T17:33:16.330Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.337Z","job_size_bytes":66,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4f062fb1d0530d0f8ab89288: start","job_status":"start","queue_duration_s":3.555508,"scheduling_latency_s":3.555525}2251gitlab # [ 423.336603] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.927Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4f062fb1d0530d0f8ab89288","created_at":"2026-08-16T17:33:16.330Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.337Z","job_size_bytes":66,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4f062fb1d0530d0f8ab89288: done: 0.034986 sec","job_status":"done","queue_duration_s":3.555508,"scheduling_latency_s":3.555525,"redis_calls":10,"redis_duration_s":0.001811,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032958,"duration_s":0.034986,"completed_at":"2026-08-16T17:33:19.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004838,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2252gitlab # [ 423.382488] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3832253gitlab # [ 423.385017] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 532254gitlab # [ 423.387041] gitaly[894]: time="2026-08-16T17:33:19.932Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T55DVTSXFWFVDS24CT50J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:29.225" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:19.926" grpc.time_ms=6.752 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2255gitlab # [ 423.401584] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.929Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b4f9c2d3d99166f78661ddc8","created_at":"2026-08-16T17:33:16.338Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.346Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b4f9c2d3d99166f78661ddc8: start","job_status":"start","queue_duration_s":3.583074,"scheduling_latency_s":3.583091}2256gitlab # [ 423.417826] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.980Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b4f9c2d3d99166f78661ddc8","created_at":"2026-08-16T17:33:16.338Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.346Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b4f9c2d3d99166f78661ddc8: done: 0.050554 sec","job_status":"done","queue_duration_s":3.583074,"scheduling_latency_s":3.583091,"redis_calls":10,"redis_duration_s":0.006194,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000886,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003114,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0016907,"duration_s":0.050554,"completed_at":"2026-08-16T17:33:19.980Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2257gitlab # [ 423.462533] gitaly[894]: time="2026-08-16T17:33:19.969Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T55N20SFP3MG4H4CR2G8S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.958" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2258gitlab # [ 423.472818] nixbot[3506]: {"ts": "2026-08-16T17:33:20.253Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 \"HTTP/1.1 201 Created\""}2259gitlab # [ 423.475605] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:19.981Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"580f332275c2c30c063d587e","created_at":"2026-08-16T17:33:16.356Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.361Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-580f332275c2c30c063d587e: start","job_status":"start","queue_duration_s":3.620329,"scheduling_latency_s":3.620347}2260gitlab # [ 423.492137] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.025Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"580f332275c2c30c063d587e","created_at":"2026-08-16T17:33:16.356Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.361Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-580f332275c2c30c063d587e: done: 0.043726 sec","job_status":"done","queue_duration_s":3.620329,"scheduling_latency_s":3.620347,"redis_calls":10,"redis_duration_s":0.002759,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000334,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002872,"duration_s":0.043726,"completed_at":"2026-08-16T17:33:20.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2261gitlab # [ 423.535992] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f1d3076aa9d75503284693a44993120775e11fd2 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1812262gitlab # [ 423.538406] gitlab-workhorse[821]: time="2026-08-16T17:33:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2212263gitlab # [ 423.540241] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 1862264gitlab # [ 423.542099] gitaly[894]: time="2026-08-16T17:33:19.969Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55N20SFP3MG4H4CR2G8S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.958" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2265gitlab # [ 423.555482] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.026Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5510fc05b1b64db445cf064e","created_at":"2026-08-16T17:33:16.362Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.367Z","job_size_bytes":6,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5510fc05b1b64db445cf064e: start","job_status":"start","queue_duration_s":3.659596,"scheduling_latency_s":3.659616}2266gitlab # [ 423.571412] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5510fc05b1b64db445cf064e","created_at":"2026-08-16T17:33:16.362Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.367Z","job_size_bytes":6,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5510fc05b1b64db445cf064e: done: 0.027333 sec","job_status":"done","queue_duration_s":3.659596,"scheduling_latency_s":3.659616,"redis_calls":10,"redis_duration_s":0.002105,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000591,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00039,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024956,"duration_s":0.027333,"completed_at":"2026-08-16T17:33:20.054Z","load_balancing_strategy":"primary","db_duration_s":0.002121,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2267gitlab # [ 423.616214] gitaly[894]: time="2026-08-16T17:33:19.969Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55N20SFP3MG4H4CR2G8S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:19.958" grpc.time_ms=10.887 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2268gitlab # [ 423.630537] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.055Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"fb9b50995037128f9a313ced","created_at":"2026-08-16T17:33:16.369Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.374Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fb9b50995037128f9a313ced: start","job_status":"start","queue_duration_s":3.681256,"scheduling_latency_s":3.681278}2269gitlab # [ 423.646258] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.095Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"fb9b50995037128f9a313ced","created_at":"2026-08-16T17:33:16.369Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.374Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-fb9b50995037128f9a313ced: done: 0.039611 sec","job_status":"done","queue_duration_s":3.681256,"scheduling_latency_s":3.681278,"redis_calls":10,"redis_duration_s":0.0019060000000000001,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000724,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025004,"duration_s":0.039611,"completed_at":"2026-08-16T17:33:20.094Z","load_balancing_strategy":"primary","db_duration_s":0.00713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2270gitlab # [ 423.690314] gitaly[894]: time="2026-08-16T17:33:20.071Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05T55RJPJM6Y3SKVV587PJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:20.063" grpc.time_ms=8.243 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2271gitlab # [ 423.703532] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.097Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a049fc667810511b670c5e60","created_at":"2026-08-16T17:33:16.381Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.386Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a049fc667810511b670c5e60: start","job_status":"start","queue_duration_s":3.710492,"scheduling_latency_s":3.710511}2272gitlab # [ 423.720124] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.168Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a049fc667810511b670c5e60","created_at":"2026-08-16T17:33:16.381Z","trace_propagation_headers":{"sentry-trace":"f07ab73febee4daeaff08eb52ba09f61-9062727ab47b4230","baggage":"sentry-trace_id=f07ab73febee4daeaff08eb52ba09f61,sentry-release=Unknown"},"correlation_id":"01M05T2E490W61FEBFN5HGJBHF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.386Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a049fc667810511b670c5e60: done: 0.071174 sec","job_status":"done","queue_duration_s":3.710492,"scheduling_latency_s":3.710511,"redis_calls":14,"redis_duration_s":0.002539,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001423,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027524,"duration_s":0.071174,"completed_at":"2026-08-16T17:33:20.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2273gitlab # [ 423.763920] gitaly[894]: time="2026-08-16T17:33:20.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55T3TW5KBHKXZM5JZVFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:50.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:20.127" grpc.time_ms=0.56 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2274gitlab # [ 423.776999] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8bd886aa6da7dcfda2e294c8","created_at":"2026-08-16T17:33:16.641Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-547ffce8f0c4499b","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.652Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8bd886aa6da7dcfda2e294c8: start","job_status":"start","queue_duration_s":3.518542,"scheduling_latency_s":3.518584}2275gitlab # [ 423.792838] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.226Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8bd886aa6da7dcfda2e294c8","created_at":"2026-08-16T17:33:16.641Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-547ffce8f0c4499b","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:16.652Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8bd886aa6da7dcfda2e294c8: done: 0.055822 sec","job_status":"done","queue_duration_s":3.518542,"scheduling_latency_s":3.518584,"redis_calls":19,"redis_duration_s":0.005414,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001861,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000462,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002566,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00899544,"duration_s":0.055822,"completed_at":"2026-08-16T17:33:20.226Z","load_balancing_strategy":"primary","db_duration_s":0.006155,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2276gitlab # [ 423.838893] gitaly[894]: time="2026-08-16T17:33:20.198Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=8 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05T55T3TW5KBHKXZM5JZVFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:30.166" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:20.186" grpc.time_ms=11.722 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2277gitlab # [ 423.852413] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.228Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e8a1fbbcfd932a2c4bc6c704"],"class":"WebHooks::LogExecutionWorker","jid":"75a3372f6793b28d364a2ddb","created_at":"2026-08-16T17:33:18.422Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-1bc7b469a1d94a3f","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2dfc41f83559c8af5d379ff43672b7eb11e162aa06e5e286697e3408a4340327","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:18.435Z","job_size_bytes":2592,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-75a3372f6793b28d364a2ddb: start","job_status":"start","queue_duration_s":1.793298,"scheduling_latency_s":1.793318}2278gitlab # [ 423.869258] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.278Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e8a1fbbcfd932a2c4bc6c704"],"class":"WebHooks::LogExecutionWorker","jid":"75a3372f6793b28d364a2ddb","created_at":"2026-08-16T17:33:18.422Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-1bc7b469a1d94a3f","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2dfc41f83559c8af5d379ff43672b7eb11e162aa06e5e286697e3408a4340327","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:18.435Z","job_size_bytes":2592,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-75a3372f6793b28d364a2ddb: done: 0.049973 sec","job_status":"done","queue_duration_s":1.793298,"scheduling_latency_s":1.793318,"redis_calls":10,"redis_duration_s":0.001918,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031208,"duration_s":0.049973,"completed_at":"2026-08-16T17:33:20.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 423.913800] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3652280gitlab # [ 423.916601] gitaly[894]: time="2026-08-16T17:33:20.259Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T55T9HTQQE41KCHNTTBZ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:20.243" pid=894 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc2281gitlab # [ 423.926635] nixbot[3506]: {"ts": "2026-08-16T17:33:20.655Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 \"HTTP/1.1 201 Created\""}2282gitlab # [ 423.929414] nixbot[3506]: {"ts": "2026-08-16T17:33:20.672Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-95b5b88c7996-4"}2283gitlab # [ 423.931640] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.280Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7fbefa875b9f3c9313ab422f"],"class":"WebHooks::LogExecutionWorker","jid":"2ae3e6e21992a612678f8ee4","created_at":"2026-08-16T17:33:19.530Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-b674accbf2974591","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5eb103245a967f7d2971c3597005a56239ac7f753aad44cb6f7818e0ca60de6d","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:19.535Z","job_size_bytes":2592,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2ae3e6e21992a612678f8ee4: start","job_status":"start","queue_duration_s":0.74455,"scheduling_latency_s":0.744571}2284gitlab # [ 423.948347] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.306Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","7fbefa875b9f3c9313ab422f"],"class":"WebHooks::LogExecutionWorker","jid":"2ae3e6e21992a612678f8ee4","created_at":"2026-08-16T17:33:19.530Z","trace_propagation_headers":{"sentry-trace":"70aa3db9467149bc999bc85d9b1353f1-b674accbf2974591","baggage":"sentry-trace_id=70aa3db9467149bc999bc85d9b1353f1,sentry-release=Unknown"},"correlation_id":"01M05T2CAGEPZPN148AXVZQ3AY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5eb103245a967f7d2971c3597005a56239ac7f753aad44cb6f7818e0ca60de6d","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:19.535Z","job_size_bytes":2592,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2ae3e6e21992a612678f8ee4: done: 0.02578 sec","job_status":"done","queue_duration_s":0.74455,"scheduling_latency_s":0.744571,"redis_calls":7,"redis_duration_s":0.001236,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000288,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02578,"completed_at":"2026-08-16T17:33:20.306Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2285gitlab # [ 423.991009] gitaly[894]: time="2026-08-16T17:33:20.259Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55T9HTQQE41KCHNTTBZ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:20.243" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2286gitlab # [ 424.004852] nix-daemon[3715]: accepted connection from pid 4357, user nixbot2287gitlab # [ 424.005779] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.307Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"17e8eeb5df88bfe948d37424","created_at":"2026-08-16T17:33:19.602Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-9377683ba58d4929","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:19.621Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-17e8eeb5df88bfe948d37424: start","job_status":"start","queue_duration_s":0.686112,"scheduling_latency_s":0.686129}2288gitlab # [ 424.022623] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.566Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"17e8eeb5df88bfe948d37424","created_at":"2026-08-16T17:33:19.602Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-9377683ba58d4929","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:19.621Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3452,"job_status":"rescheduled","message":"PipelineProcessWorker JID-17e8eeb5df88bfe948d37424: rescheduled"}2289gitlab # [ 424.037393] gitaly[894]: time="2026-08-16T17:33:20.261Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T55T9HTQQE41KCHNTTBZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:20.243" grpc.time_ms=16.705 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2290gitlab # [ 424.052167] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.573Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"17e8eeb5df88bfe948d37424","created_at":"2026-08-16T17:33:19.602Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-9377683ba58d4929","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:19.621Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-17e8eeb5df88bfe948d37424: done: 0.266126 sec","job_status":"done","queue_duration_s":0.686112,"scheduling_latency_s":0.686129,"gitaly_calls":3,"gitaly_duration_s":0.091326,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009572,"redis_read_bytes":147,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000396,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000772,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002403,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003199,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000414,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000794,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.133549,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.22847642,"duration_s":0.266126,"completed_at":"2026-08-16T17:33:20.573Z","load_balancing_strategy":"primary","db_duration_s":0.037811,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2291gitlab # [ 424.102948] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.574Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e8702ebe582c348c29e7635c","created_at":"2026-08-16T17:33:20.210Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-74f708ee6dda442f","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.217Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e8702ebe582c348c29e7635c: start","job_status":"start","queue_duration_s":0.35785,"scheduling_latency_s":0.357874}2292gitlab # [ 424.119791] gitaly[894]: time="2026-08-16T17:33:20.346Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:50.244" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:20.345" grpc.time_ms=0.636 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2293gitlab # [ 424.132955] nixbot[3506]: {"ts": "2026-08-16T17:33:20.906Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-95b5b88c7996-4", "argv0": "bwrap"}2294gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71'2295gitlab # [ 424.135305] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e8702ebe582c348c29e7635c","created_at":"2026-08-16T17:33:20.210Z","trace_propagation_headers":{"sentry-trace":"526146b0ffb54748a836b32da8eaf8ca-74f708ee6dda442f","baggage":"sentry-trace_id=526146b0ffb54748a836b32da8eaf8ca,sentry-release=Unknown"},"correlation_id":"01M05T28AVPS49QVQRT7FCGSA4","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.217Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e8702ebe582c348c29e7635c: done: 0.103086 sec","job_status":"done","queue_duration_s":0.35785,"scheduling_latency_s":0.357874,"redis_calls":11,"redis_duration_s":0.002287,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00037,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024642,"duration_s":0.103086,"completed_at":"2026-08-16T17:33:20.677Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 424.179606] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.679Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6ec213d5e3ffcd21e76d2033","created_at":"2026-08-16T17:33:20.373Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.375Z","job_size_bytes":23,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6ec213d5e3ffcd21e76d2033: start","job_status":"start","queue_duration_s":0.304256,"scheduling_latency_s":0.304276}2297gitlab # [ 424.195232] nix-daemon[3715]: accepted connection from pid 4365, user nixbot2298gitlab # [ 424.196142] gitaly[894]: time="2026-08-16T17:33:20.368Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:33:50.254" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:20.354" grpc.time_ms=13.619 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2299gitlab # [ 424.208761] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.725Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6ec213d5e3ffcd21e76d2033","created_at":"2026-08-16T17:33:20.373Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.375Z","job_size_bytes":23,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6ec213d5e3ffcd21e76d2033: done: 0.046129 sec","job_status":"done","queue_duration_s":0.304256,"scheduling_latency_s":0.304276,"redis_calls":7,"redis_duration_s":0.001073,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046129,"completed_at":"2026-08-16T17:33:20.725Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01173,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2300gitlab # [ 424.251189] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.726Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"dd4eda3975f6cc7560e9d2b1","created_at":"2026-08-16T17:33:20.469Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.471Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-dd4eda3975f6cc7560e9d2b1: start","job_status":"start","queue_duration_s":0.255103,"scheduling_latency_s":0.25512}2301gitlab # [ 424.267815] gitaly[894]: time="2026-08-16T17:33:20.387Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:30.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:20.377" grpc.time_ms=10.175 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2302gitlab # [ 424.281572] gitaly[894]: time="2026-08-16T17:33:20.409Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:20.409" grpc.time_ms=0.372 pid=894 span.kind=server system=grpc2303gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71', in 0.15 seconds)2304(finished: subtest: push delivers the webhook, in 92.93 seconds)2305subtest: eval and build post commit statuses2306gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses2307gitlab # [ 424.291184] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.755Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"dd4eda3975f6cc7560e9d2b1","created_at":"2026-08-16T17:33:20.469Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.471Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-dd4eda3975f6cc7560e9d2b1: done: 0.029128 sec","job_status":"done","queue_duration_s":0.255103,"scheduling_latency_s":0.25512,"redis_calls":7,"redis_duration_s":0.00107,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029128,"completed_at":"2026-08-16T17:33:20.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2308gitlab # [ 424.333706] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.756Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"88172ce5c3f0f930aba0b4f1","created_at":"2026-08-16T17:33:20.477Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.481Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-88172ce5c3f0f930aba0b4f1: start","job_status":"start","queue_duration_s":0.274978,"scheduling_latency_s":0.274995}2309gitlab # [ 424.349497] gitaly[894]: time="2026-08-16T17:33:20.432Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:20.431" grpc.time_ms=0.412 pid=894 span.kind=server system=grpc2310gitlab # [ 424.359428] gitaly[894]: time="2026-08-16T17:33:20.433Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:33:30.061" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:20.432" grpc.time_ms=0.375 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2311gitlab # [ 424.370619] nixbot[3506]: INFO: ::ffff:127.0.0.1:37656 - "GET /api/repos/gitlab/root/test-flake/builds?commit=95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 200 OK2312gitlab # [ 424.372589] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.789Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"88172ce5c3f0f930aba0b4f1","created_at":"2026-08-16T17:33:20.477Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.481Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-88172ce5c3f0f930aba0b4f1: done: 0.032499 sec","job_status":"done","queue_duration_s":0.274978,"scheduling_latency_s":0.274995,"redis_calls":7,"redis_duration_s":0.001043,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032499,"completed_at":"2026-08-16T17:33:20.789Z","load_balancing_strategy":"primary","db_duration_s":0.008171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2313gitlab # [ 424.414430] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.790Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a42c787f2740c6f69be4801c","created_at":"2026-08-16T17:33:20.494Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.496Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a42c787f2740c6f69be4801c: start","job_status":"start","queue_duration_s":0.293735,"scheduling_latency_s":0.293752}2314gitlab # [ 424.431132] gitaly[894]: time="2026-08-16T17:33:20.451Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:33:30.070" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:20.440" grpc.time_ms=10.496 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2315gitlab # [ 424.444538] gitaly[894]: time="2026-08-16T17:33:20.457Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:20.456" grpc.time_ms=0.517 pid=894 span.kind=server system=grpc2316gitlab # [ 424.453991] nix-daemon[3715]: accepted connection from pid 4383, user nixbot2317gitlab # [ 424.454944] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"a42c787f2740c6f69be4801c","created_at":"2026-08-16T17:33:20.494Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.496Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-a42c787f2740c6f69be4801c: done: 0.036065 sec","job_status":"done","queue_duration_s":0.293735,"scheduling_latency_s":0.293752,"redis_calls":10,"redis_duration_s":0.001496,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000363,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036065,"completed_at":"2026-08-16T17:33:20.826Z","load_balancing_strategy":"primary","db_duration_s":0.010171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2318gitlab # [ 424.497997] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"623bc81ebdf14b844d2c1ae4","created_at":"2026-08-16T17:33:20.497Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.499Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-623bc81ebdf14b844d2c1ae4: start","job_status":"start","queue_duration_s":0.328797,"scheduling_latency_s":0.328831}2319gitlab # [ 424.514378] gitaly[894]: time="2026-08-16T17:33:20.464Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP diskcache=e5dfaeb6-c89c-4e44-8b1b-d5626d1dcbee grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:50.381" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:20.381" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 424.524068] gitaly[894]: time="2026-08-16T17:33:20.464Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7178 command.oublock=0 command.real_time_ms=78 command.spawn_token_fork_ms=0 command.system_time_ms=35 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:50.381" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:20.381" grpc.time_ms=82.446 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2321gitlab # [ 424.537046] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.858Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"623bc81ebdf14b844d2c1ae4","created_at":"2026-08-16T17:33:20.497Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.499Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-623bc81ebdf14b844d2c1ae4: done: 0.030874 sec","job_status":"done","queue_duration_s":0.328797,"scheduling_latency_s":0.328831,"redis_calls":7,"redis_duration_s":0.001076,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030874,"completed_at":"2026-08-16T17:33:20.858Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007601,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2322gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses, in 0.27 seconds)2323gitlab # [ 424.579541] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"be43fe43c697d83b7d4f15c7","created_at":"2026-08-16T17:33:20.499Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.501Z","job_size_bytes":19,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-be43fe43c697d83b7d4f15c7: start","job_status":"start","queue_duration_s":0.358227,"scheduling_latency_s":0.358245}2324gitlab # [ 424.595065] gitaly[894]: time="2026-08-16T17:33:20.487Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:20.484" grpc.time_ms=3.384 pid=894 span.kind=server system=grpc2325gitlab # [ 424.605095] gitaly[894]: time="2026-08-16T17:33:20.518Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:20.518" grpc.time_ms=0.458 pid=894 span.kind=server system=grpc2326gitlab # [ 424.614619] nix-daemon[3715]: accepted connection from pid 4395, user nixbot2327gitlab # [ 424.615546] nix-daemon[3715]: accepted connection from pid 4402, user nixbot2328gitlab # [ 424.616927] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1882329gitlab # [ 424.619494] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"be43fe43c697d83b7d4f15c7","created_at":"2026-08-16T17:33:20.499Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.501Z","job_size_bytes":19,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-be43fe43c697d83b7d4f15c7: done: 0.027314 sec","job_status":"done","queue_duration_s":0.358227,"scheduling_latency_s":0.358245,"redis_calls":8,"redis_duration_s":0.001131,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027314,"completed_at":"2026-08-16T17:33:20.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007203,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2330gitlab # [ 424.663922] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.888Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"60838f31d581317e4b9671f9","created_at":"2026-08-16T17:33:20.502Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.504Z","job_size_bytes":66,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-60838f31d581317e4b9671f9: start","job_status":"start","queue_duration_s":0.383913,"scheduling_latency_s":0.383932}2331gitlab # [ 424.681662] gitaly[894]: time="2026-08-16T17:33:20.522Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:33:50.521" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:20.521" grpc.time_ms=0.883 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2332gitlab # [ 424.694466] nix-daemon[3715]: accepted connection from pid 4383, user nixbot2333gitlab # [ 424.695446] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.917Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"60838f31d581317e4b9671f9","created_at":"2026-08-16T17:33:20.502Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.504Z","job_size_bytes":66,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-60838f31d581317e4b9671f9: done: 0.028595 sec","job_status":"done","queue_duration_s":0.383913,"scheduling_latency_s":0.383932,"redis_calls":7,"redis_duration_s":0.0010119999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028595,"completed_at":"2026-08-16T17:33:20.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008764,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2334gitlab # [ 424.738789] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.918Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"27fbc9ba20728ae60932f3d1","created_at":"2026-08-16T17:33:20.505Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.506Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-27fbc9ba20728ae60932f3d1: start","job_status":"start","queue_duration_s":0.411476,"scheduling_latency_s":0.411493}2335gitlab # [ 424.755231] gitaly[894]: time="2026-08-16T17:33:20.532Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK diskcache=5d318851-47e8-404f-a538-90c98eaccf22 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:33:30.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:20.454" pid=894 ref=refs/keep-around/95b5b88c7996170330c22dfac39ae3789732fb71 remote_ip="2001:db8:1::1" revision=95b5b88c7996170330c22dfac39ae3789732fb71 span.kind=server system=grpc username=root2336gitlab # [ 424.766771] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.945Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"27fbc9ba20728ae60932f3d1","created_at":"2026-08-16T17:33:20.505Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.506Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-27fbc9ba20728ae60932f3d1: done: 0.026785 sec","job_status":"done","queue_duration_s":0.411476,"scheduling_latency_s":0.411493,"redis_calls":7,"redis_duration_s":0.0009710000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026785,"completed_at":"2026-08-16T17:33:20.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2337gitlab # [ 424.809458] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.946Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e2f38cb0f7db1e607995a404","created_at":"2026-08-16T17:33:20.507Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.509Z","job_size_bytes":6,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e2f38cb0f7db1e607995a404: start","job_status":"start","queue_duration_s":0.437174,"scheduling_latency_s":0.437191}2338gitlab # [ 424.825252] gitaly[894]: time="2026-08-16T17:33:20.532Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5228 command.oublock=8 command.real_time_ms=69 command.spawn_token_fork_ms=3 command.system_time_ms=40 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:33:30.084" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:33:20.454" grpc.time_ms=77.408 pid=894 ref=refs/keep-around/95b5b88c7996170330c22dfac39ae3789732fb71 remote_ip="2001:db8:1::1" revision=95b5b88c7996170330c22dfac39ae3789732fb71 span.kind=server system=grpc username=root2339gitlab # [ 424.840863] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.960Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"e2f38cb0f7db1e607995a404","created_at":"2026-08-16T17:33:20.507Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.509Z","job_size_bytes":6,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-e2f38cb0f7db1e607995a404: done: 0.014286 sec","job_status":"done","queue_duration_s":0.437174,"scheduling_latency_s":0.437191,"redis_calls":7,"redis_duration_s":0.001266,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014286,"completed_at":"2026-08-16T17:33:20.960Z","load_balancing_strategy":"primary","db_duration_s":0.00055,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2340gitlab # [ 424.882752] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.962Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"defc5f0937adad97a6b45968","created_at":"2026-08-16T17:33:20.509Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.511Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-defc5f0937adad97a6b45968: start","job_status":"start","queue_duration_s":0.450827,"scheduling_latency_s":0.450843}2341gitlab # [ 424.898168] gitaly[894]: time="2026-08-16T17:33:20.536Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:50.435" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:20.535" grpc.time_ms=0.435 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab # [ 424.910884] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.988Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"defc5f0937adad97a6b45968","created_at":"2026-08-16T17:33:20.509Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.511Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-defc5f0937adad97a6b45968: done: 0.026283 sec","job_status":"done","queue_duration_s":0.450827,"scheduling_latency_s":0.450843,"redis_calls":7,"redis_duration_s":0.0017469999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026283,"completed_at":"2026-08-16T17:33:20.988Z","load_balancing_strategy":"primary","db_duration_s":0.006158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2343gitlab # [ 424.952087] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:20.989Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4f3c3e8dba974ef94a78a40c","created_at":"2026-08-16T17:33:20.546Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-c0e697a75376469e","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.554Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4f3c3e8dba974ef94a78a40c: start","job_status":"start","queue_duration_s":0.435758,"scheduling_latency_s":0.435773}2344gitlab # [ 424.969053] gitaly[894]: time="2026-08-16T17:33:20.557Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T54KKEAYA7AX4Y31X6CXP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:50.556" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:20.556" grpc.time_ms=0.65 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab # [ 424.981385] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.023Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"4f3c3e8dba974ef94a78a40c","created_at":"2026-08-16T17:33:20.546Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-c0e697a75376469e","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.554Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-4f3c3e8dba974ef94a78a40c: done: 0.033176 sec","job_status":"done","queue_duration_s":0.435758,"scheduling_latency_s":0.435773,"redis_calls":7,"redis_duration_s":0.001824,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033176,"completed_at":"2026-08-16T17:33:21.022Z","load_balancing_strategy":"primary","db_duration_s":0.00888,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2346gitlab # [ 425.024056] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.024Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"cd9913dedb33ffe273d3cff0","created_at":"2026-08-16T17:33:20.555Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-c0e697a75376469e","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.560Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-cd9913dedb33ffe273d3cff0: start","job_status":"start","queue_duration_s":0.464567,"scheduling_latency_s":0.464584}2347gitlab # [ 425.042501] gitaly[894]: time="2026-08-16T17:33:21.290Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:33:51.288" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:21.288" grpc.time_ms=0.964 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2348gitlab # [ 425.055260] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.110Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"cd9913dedb33ffe273d3cff0","created_at":"2026-08-16T17:33:20.555Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-c0e697a75376469e","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.560Z","job_size_bytes":65,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-cd9913dedb33ffe273d3cff0: done: 0.085708 sec","job_status":"done","queue_duration_s":0.464567,"scheduling_latency_s":0.464584,"redis_calls":10,"redis_duration_s":0.011865,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.004582,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085708,"completed_at":"2026-08-16T17:33:21.110Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2349gitlab # [ 425.099854] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.112Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2b3474972a35ebdd6ae4c74f","created_at":"2026-08-16T17:33:20.566Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.568Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2b3474972a35ebdd6ae4c74f: start","job_status":"start","queue_duration_s":0.544051,"scheduling_latency_s":0.54407}2350gitlab # [ 425.116179] gitaly[894]: time="2026-08-16T17:33:21.325Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T56XFYPDV2119NE520NM6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:51.224" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:21.324" grpc.time_ms=0.565 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 425.128725] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.160Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2b3474972a35ebdd6ae4c74f","created_at":"2026-08-16T17:33:20.566Z","trace_propagation_headers":{"sentry-trace":"075d727d4c1a47d9bf1a384041099d99-cb374b98c00944b0","baggage":"sentry-trace_id=075d727d4c1a47d9bf1a384041099d99,sentry-release=Unknown"},"correlation_id":"01M05T54KKEAYA7AX4Y31X6CXP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.568Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2b3474972a35ebdd6ae4c74f: done: 0.048426 sec","job_status":"done","queue_duration_s":0.544051,"scheduling_latency_s":0.54407,"redis_calls":8,"redis_duration_s":0.012565,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011748,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048426,"completed_at":"2026-08-16T17:33:21.160Z","load_balancing_strategy":"primary","db_duration_s":0.01164,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2352gitlab # [ 425.170343] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.162Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e826db5f5a54aa4354774108","created_at":"2026-08-16T17:33:20.630Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-c0e697a75376469e","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.635Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e826db5f5a54aa4354774108: start","job_status":"start","queue_duration_s":0.52667,"scheduling_latency_s":0.526697}2353gitlab # [ 425.186025] gitaly[894]: time="2026-08-16T17:33:21.332Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5616XVBRYT8RHM7VJKAK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:51.331" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:21.331" grpc.time_ms=0.703 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 425.198620] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.350Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e826db5f5a54aa4354774108","created_at":"2026-08-16T17:33:20.630Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-c0e697a75376469e","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:20.635Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e826db5f5a54aa4354774108: done: 0.188705 sec","job_status":"done","queue_duration_s":0.52667,"scheduling_latency_s":0.526697,"gitaly_calls":2,"gitaly_duration_s":0.006472,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018694,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002391,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001065,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.004175,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004229,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000235,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000804,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.119435,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13921164,"duration_s":0.188705,"completed_at":"2026-08-16T17:33:21.350Z","load_balancing_strategy":"primary","db_duration_s":0.055719,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2355gitlab # [ 425.250386] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2855b5d134aa1d90b1433d5f","created_at":"2026-08-16T17:33:21.259Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-180aa1deb945431c","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:21.261Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2855b5d134aa1d90b1433d5f: start","job_status":"start","queue_duration_s":0.093644,"scheduling_latency_s":0.093666}2356gitlab # [ 425.266693] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:21.395Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"2855b5d134aa1d90b1433d5f","created_at":"2026-08-16T17:33:21.259Z","trace_propagation_headers":{"sentry-trace":"63cec94175ed4f3fb4086d4dd45f1fa4-180aa1deb945431c","baggage":"sentry-trace_id=63cec94175ed4f3fb4086d4dd45f1fa4,sentry-release=Unknown"},"correlation_id":"01M05T5616XVBRYT8RHM7VJKAK","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:21.261Z","job_size_bytes":3,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-2855b5d134aa1d90b1433d5f: done: 0.039875 sec","job_status":"done","queue_duration_s":0.093644,"scheduling_latency_s":0.093666,"redis_calls":7,"redis_duration_s":0.002525,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029113,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039875,"completed_at":"2026-08-16T17:33:21.395Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2357gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses2358gitlab # [ 425.811758] gitaly[894]: time="2026-08-16T17:33:22.626Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T585R97G474S6VDGDXXEG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:52.524" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:22.624" grpc.time_ms=1.179 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses, in 0.29 seconds)2360gitlab # [ 425.875956] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 2002361gitlab # [ 426.051953] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:22.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"22cebf56c721dbdce2cb0d2d","created_at":"2026-08-16T17:33:22.848Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ab4a1a31c1af8e84e6109c2d8d5d4de","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.860Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-22cebf56c721dbdce2cb0d2d: start","job_status":"start","queue_duration_s":0.004342,"scheduling_latency_s":0.004391}2362gitlab # [ 426.177071] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:22.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"22cebf56c721dbdce2cb0d2d","created_at":"2026-08-16T17:33:22.848Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ab4a1a31c1af8e84e6109c2d8d5d4de","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.860Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-22cebf56c721dbdce2cb0d2d: done: 0.125897 sec","job_status":"done","queue_duration_s":0.004342,"scheduling_latency_s":0.004391,"redis_calls":12,"redis_duration_s":0.016239,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009043,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005154,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00299418,"exclusive_lock_hold_duration_s":0.024669299999999998,"duration_s":0.125897,"completed_at":"2026-08-16T17:33:22.990Z","load_balancing_strategy":"primary","db_duration_s":0.013016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2363gitlab # [ 426.271777] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:22.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"580b7d353e485a980bceb71d","created_at":"2026-08-16T17:33:22.881Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e016b33566509be4e75f6e87ee288295","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.890Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-580b7d353e485a980bceb71d: start","job_status":"start","queue_duration_s":0.10446,"scheduling_latency_s":0.104501}2364gitlab # [ 426.317407] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:23.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"580b7d353e485a980bceb71d","created_at":"2026-08-16T17:33:22.881Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e016b33566509be4e75f6e87ee288295","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.890Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-580b7d353e485a980bceb71d: done: 0.135919 sec","job_status":"done","queue_duration_s":0.10446,"scheduling_latency_s":0.104501,"redis_calls":11,"redis_duration_s":0.031232,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.014151,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012692,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004389,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.135919,"completed_at":"2026-08-16T17:33:23.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2365gitlab # [ 426.390433] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:23.146Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bb4c55cfb7d73874c14d99b5","created_at":"2026-08-16T17:33:22.899Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe224055783a901ef030d81200dd9b87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.918Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bb4c55cfb7d73874c14d99b5: start","job_status":"start","queue_duration_s":0.228136,"scheduling_latency_s":0.228179}2366gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses2367gitlab # [ 427.047979] gitaly[894]: time="2026-08-16T17:33:23.861Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T59D9KGNXSD299QGCMZV1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:53.758" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:23.859" grpc.time_ms=1.405 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2368gitlab # [ 427.107741] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1672369gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses, in 0.24 seconds)2370gitlab # [ 427.579211] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"bb4c55cfb7d73874c14d99b5","created_at":"2026-08-16T17:33:22.899Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe224055783a901ef030d81200dd9b87","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.918Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-bb4c55cfb7d73874c14d99b5: done: 1.245876 sec","job_status":"done","queue_duration_s":0.228136,"scheduling_latency_s":0.228179,"redis_calls":13,"redis_duration_s":0.020855000000000002,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010814,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005858,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.199,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.187,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.655477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0023295,"exclusive_lock_hold_duration_s":1.13224038,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":1.245876,"completed_at":"2026-08-16T17:33:24.392Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.581836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 427.677559] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c3e938c1142e4130433a7e89","created_at":"2026-08-16T17:33:22.934Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ba47b0133ea44ae95fb373671b00081","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.987Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c3e938c1142e4130433a7e89: start","job_status":"start","queue_duration_s":1.407439,"scheduling_latency_s":1.40747}2372gitlab # [ 427.696063] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c3e938c1142e4130433a7e89","created_at":"2026-08-16T17:33:22.934Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ba47b0133ea44ae95fb373671b00081","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:22.987Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c3e938c1142e4130433a7e89: done: 0.058402 sec","job_status":"done","queue_duration_s":1.407439,"scheduling_latency_s":1.40747,"redis_calls":9,"redis_duration_s":0.003614,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000562,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.058402,"completed_at":"2026-08-16T17:33:24.452Z","load_balancing_strategy":"primary","db_duration_s":0.020239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab # [ 427.754140] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.456Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a3a9ed974ab365f0b236fce9","created_at":"2026-08-16T17:33:23.025Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42a5bbdb1e7251563bbfed59c872e4ff","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.064Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a3a9ed974ab365f0b236fce9: start","job_status":"start","queue_duration_s":1.3917,"scheduling_latency_s":1.391732}2374gitlab # [ 427.769993] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a3a9ed974ab365f0b236fce9","created_at":"2026-08-16T17:33:23.025Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42a5bbdb1e7251563bbfed59c872e4ff","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.064Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a3a9ed974ab365f0b236fce9: done: 0.050034 sec","job_status":"done","queue_duration_s":1.3917,"scheduling_latency_s":1.391732,"redis_calls":12,"redis_duration_s":0.004132,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000666,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00199,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001476,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01381714,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.050034,"completed_at":"2026-08-16T17:33:24.505Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004748,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2375gitlab # [ 427.813663] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5223bf8dd47f38f00da68a9d","created_at":"2026-08-16T17:33:23.095Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f8803307e4699d800ae7d0c15480a6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:33:23.122Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5223bf8dd47f38f00da68a9d: start","job_status":"start","queue_duration_s":1.385695,"scheduling_latency_s":1.385723}2376gitlab # [ 427.826964] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.525Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2377gitlab # [ 427.830375] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5223bf8dd47f38f00da68a9d","created_at":"2026-08-16T17:33:23.095Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f8803307e4699d800ae7d0c15480a6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:33:23.122Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5223bf8dd47f38f00da68a9d: done: 0.026998 sec","job_status":"done","queue_duration_s":1.385695,"scheduling_latency_s":1.385723,"redis_calls":9,"redis_duration_s":0.002789,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00071,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001481,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026998,"completed_at":"2026-08-16T17:33:24.535Z","load_balancing_strategy":"primary","db_duration_s":0.00077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2378gitlab # [ 427.871024] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8fa929d2210c6fc06cd82fb7","created_at":"2026-08-16T17:33:23.139Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.156Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8fa929d2210c6fc06cd82fb7: start","job_status":"start","queue_duration_s":1.380744,"scheduling_latency_s":1.380768}2379gitlab # [ 427.884243] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8fa929d2210c6fc06cd82fb7","created_at":"2026-08-16T17:33:23.139Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.156Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8fa929d2210c6fc06cd82fb7: done: 0.077506 sec","job_status":"done","queue_duration_s":1.380744,"scheduling_latency_s":1.380768,"redis_calls":18,"redis_duration_s":0.005648,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001126,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000868,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002732,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.077506,"completed_at":"2026-08-16T17:33:24.614Z","load_balancing_strategy":"primary","db_duration_s":0.020516,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 427.927102] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7d55b259ad39d6ad2277b348","created_at":"2026-08-16T17:33:23.169Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"069629194502abf6479fa6a0c2618a34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.193Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7d55b259ad39d6ad2277b348: start","job_status":"start","queue_duration_s":1.423357,"scheduling_latency_s":1.423378}2381gitlab # [ 427.941318] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.630Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2382gitlab # [ 427.944408] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7d55b259ad39d6ad2277b348","created_at":"2026-08-16T17:33:23.169Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"069629194502abf6479fa6a0c2618a34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.193Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7d55b259ad39d6ad2277b348: done: 0.021267 sec","job_status":"done","queue_duration_s":1.423357,"scheduling_latency_s":1.423378,"redis_calls":9,"redis_duration_s":0.002345,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021267,"completed_at":"2026-08-16T17:33:24.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2383gitlab # [ 427.986098] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1652ef36fd0ee684a79df1f4","created_at":"2026-08-16T17:33:23.212Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2270088e506de005ee8fb95ffd9e8ddf","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.238Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1652ef36fd0ee684a79df1f4: start","job_status":"start","queue_duration_s":1.400538,"scheduling_latency_s":1.400557}2384gitlab # [ 428.000397] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"1652ef36fd0ee684a79df1f4","created_at":"2026-08-16T17:33:23.212Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2270088e506de005ee8fb95ffd9e8ddf","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.238Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-1652ef36fd0ee684a79df1f4: done: 0.024753 sec","job_status":"done","queue_duration_s":1.400538,"scheduling_latency_s":1.400557,"redis_calls":11,"redis_duration_s":0.003006,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000559,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060566,"exclusive_lock_hold_duration_s":0.00371274,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.024753,"completed_at":"2026-08-16T17:33:24.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2385gitlab # [ 428.043096] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"db280759c1f7ebd5de3b4ef3","created_at":"2026-08-16T17:33:23.274Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c52e1ab3469f08e4d01b231bc4380423","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:33:23.312Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-db280759c1f7ebd5de3b4ef3: start","job_status":"start","queue_duration_s":1.35296,"scheduling_latency_s":1.352977}2386gitlab # [ 428.056176] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"db280759c1f7ebd5de3b4ef3","created_at":"2026-08-16T17:33:23.274Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c52e1ab3469f08e4d01b231bc4380423","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:33:23.312Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-db280759c1f7ebd5de3b4ef3: done: 0.032577 sec","job_status":"done","queue_duration_s":1.35296,"scheduling_latency_s":1.352977,"redis_calls":9,"redis_duration_s":0.002359,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000493,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032577,"completed_at":"2026-08-16T17:33:24.698Z","load_balancing_strategy":"primary","db_duration_s":0.005827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2387gitlab # [ 428.096547] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"93c6bafbb1770332e5b891f2","created_at":"2026-08-16T17:33:23.359Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc430cfa51ff4f1d8a7278f1831ad29e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.383Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-93c6bafbb1770332e5b891f2: start","job_status":"start","queue_duration_s":1.316677,"scheduling_latency_s":1.316694}2388gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses2389gitlab # [ 428.111689] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"93c6bafbb1770332e5b891f2","created_at":"2026-08-16T17:33:23.359Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc430cfa51ff4f1d8a7278f1831ad29e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.383Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-93c6bafbb1770332e5b891f2: done: 0.050914 sec","job_status":"done","queue_duration_s":1.316677,"scheduling_latency_s":1.316694,"redis_calls":11,"redis_duration_s":0.0036550000000000003,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000572,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000729,"exclusive_lock_hold_duration_s":0.0219112,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.050914,"completed_at":"2026-08-16T17:33:24.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023745,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 428.154735] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:24.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ec6fa80b0f17f513dab2cb7a","created_at":"2026-08-16T17:33:23.423Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f4bba8a30f23526f67b73f6a98d7f14","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.452Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ec6fa80b0f17f513dab2cb7a: start","job_status":"start","queue_duration_s":1.300449,"scheduling_latency_s":1.300467}2391gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses, in 0.14 seconds)2392gitlab # [ 428.227480] gitaly[894]: time="2026-08-16T17:33:25.041Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5AKMVNBVCF4WCR9GJ3CN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:55.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:25.040" grpc.time_ms=1.025 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2393gitlab # [ 428.266471] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 872394gitlab # [ 428.274187] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.088Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ec6fa80b0f17f513dab2cb7a","created_at":"2026-08-16T17:33:23.423Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f4bba8a30f23526f67b73f6a98d7f14","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.452Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ec6fa80b0f17f513dab2cb7a: done: 0.335639 sec","job_status":"done","queue_duration_s":1.300449,"scheduling_latency_s":1.300467,"redis_calls":564,"redis_duration_s":0.084609,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.082942,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.284026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.335639,"completed_at":"2026-08-16T17:33:25.088Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000657,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2395gitlab # [ 428.348936] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.089Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4aecab61459ebe7b5eaa99ad","created_at":"2026-08-16T17:33:23.483Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c223da33bf9d53fc0c4a418b7a517163","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:33:23.511Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4aecab61459ebe7b5eaa99ad: start","job_status":"start","queue_duration_s":1.578326,"scheduling_latency_s":1.578347}2396gitlab # [ 428.367706] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.101Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2397gitlab # [ 428.372609] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4aecab61459ebe7b5eaa99ad","created_at":"2026-08-16T17:33:23.483Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c223da33bf9d53fc0c4a418b7a517163","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:33:23.511Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4aecab61459ebe7b5eaa99ad: done: 0.018506 sec","job_status":"done","queue_duration_s":1.578326,"scheduling_latency_s":1.578347,"redis_calls":9,"redis_duration_s":0.001577,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000363,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018506,"completed_at":"2026-08-16T17:33:25.107Z","load_balancing_strategy":"primary","db_duration_s":0.000406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 428.415591] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.109Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9fa1c1ba10072cc598192d48","created_at":"2026-08-16T17:33:23.547Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc27362984b2ffb7d1f772afd3896633","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.583Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9fa1c1ba10072cc598192d48: start","job_status":"start","queue_duration_s":1.525851,"scheduling_latency_s":1.525867}2399gitlab # [ 428.429796] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9fa1c1ba10072cc598192d48","created_at":"2026-08-16T17:33:23.547Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc27362984b2ffb7d1f772afd3896633","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.583Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9fa1c1ba10072cc598192d48: done: 0.023664 sec","job_status":"done","queue_duration_s":1.525851,"scheduling_latency_s":1.525867,"redis_calls":9,"redis_duration_s":0.00188,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000358,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023664,"completed_at":"2026-08-16T17:33:25.133Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00314,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2400gitlab # [ 428.471629] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.134Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"af5f80021946920bf4c4fb63","created_at":"2026-08-16T17:33:23.645Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c043ed3ff9f40e37bf6b1ef323543e07","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.680Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-af5f80021946920bf4c4fb63: start","job_status":"start","queue_duration_s":1.453801,"scheduling_latency_s":1.453817}2401gitlab # [ 428.486097] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.161Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"af5f80021946920bf4c4fb63","created_at":"2026-08-16T17:33:23.645Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c043ed3ff9f40e37bf6b1ef323543e07","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.680Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-af5f80021946920bf4c4fb63: done: 0.026556 sec","job_status":"done","queue_duration_s":1.453801,"scheduling_latency_s":1.453817,"redis_calls":9,"redis_duration_s":0.002214,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000459,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026556,"completed_at":"2026-08-16T17:33:25.161Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2402gitlab # [ 428.528761] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c1fe4f24ca5dc838c4d3bdd8","created_at":"2026-08-16T17:33:23.728Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f39a161d8e3e59fb602a9f8f98e32fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.768Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c1fe4f24ca5dc838c4d3bdd8: start","job_status":"start","queue_duration_s":1.393793,"scheduling_latency_s":1.39381}2403gitlab # [ 428.543362] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"c1fe4f24ca5dc838c4d3bdd8","created_at":"2026-08-16T17:33:23.728Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7f39a161d8e3e59fb602a9f8f98e32fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.768Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-c1fe4f24ca5dc838c4d3bdd8: done: 0.019135 sec","job_status":"done","queue_duration_s":1.393793,"scheduling_latency_s":1.39381,"redis_calls":9,"redis_duration_s":0.002336,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019135,"completed_at":"2026-08-16T17:33:25.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2404gitlab # [ 428.585909] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6b6dd9c29601aad229cbb984","created_at":"2026-08-16T17:33:23.791Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.817Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6b6dd9c29601aad229cbb984: start","job_status":"start","queue_duration_s":1.366014,"scheduling_latency_s":1.366031}2405gitlab # [ 428.599495] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6b6dd9c29601aad229cbb984","created_at":"2026-08-16T17:33:23.791Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.817Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6b6dd9c29601aad229cbb984: done: 0.223334 sec","job_status":"done","queue_duration_s":1.366014,"scheduling_latency_s":1.366031,"redis_calls":70,"redis_duration_s":0.017824,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002521,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000794,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013806,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000703,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.223334,"completed_at":"2026-08-16T17:33:25.406Z","load_balancing_strategy":"primary","db_duration_s":0.002761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2406gitlab # [ 428.642397] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.408Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8aee67fa56523713861c6dfc","created_at":"2026-08-16T17:33:23.862Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97349aee3e457f03abbd526bcf004679","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.884Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8aee67fa56523713861c6dfc: start","job_status":"start","queue_duration_s":1.523345,"scheduling_latency_s":1.523364}2407gitlab # [ 428.656101] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8aee67fa56523713861c6dfc","created_at":"2026-08-16T17:33:23.862Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97349aee3e457f03abbd526bcf004679","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.884Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8aee67fa56523713861c6dfc: done: 0.03083 sec","job_status":"done","queue_duration_s":1.523345,"scheduling_latency_s":1.523364,"redis_calls":11,"redis_duration_s":0.00315,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001226,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059016,"exclusive_lock_hold_duration_s":0.0082324,"duration_s":0.03083,"completed_at":"2026-08-16T17:33:25.438Z","load_balancing_strategy":"primary","db_duration_s":0.005374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2408gitlab # [ 428.696961] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"316b7177f160a0decded6efe","created_at":"2026-08-16T17:33:23.919Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b616e45e8313d742b1178316fc820eee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.944Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-316b7177f160a0decded6efe: start","job_status":"start","queue_duration_s":1.496051,"scheduling_latency_s":1.496067}2409gitlab # [ 428.711259] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.454Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2410gitlab # [ 428.714967] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"316b7177f160a0decded6efe","created_at":"2026-08-16T17:33:23.919Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b616e45e8313d742b1178316fc820eee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:23.944Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-316b7177f160a0decded6efe: done: 0.020785 sec","job_status":"done","queue_duration_s":1.496051,"scheduling_latency_s":1.496067,"redis_calls":9,"redis_duration_s":0.0022909999999999996,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000512,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020785,"completed_at":"2026-08-16T17:33:25.461Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 428.758792] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1713291c35fc4c53659e9c6c","created_at":"2026-08-16T17:33:23.992Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e768ad93774f1d8ce2f55f7efae6a8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.025Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1713291c35fc4c53659e9c6c: start","job_status":"start","queue_duration_s":1.436849,"scheduling_latency_s":1.436865}2412gitlab # [ 428.773551] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.474Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2413gitlab # [ 428.776884] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1713291c35fc4c53659e9c6c","created_at":"2026-08-16T17:33:23.992Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e768ad93774f1d8ce2f55f7efae6a8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.025Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1713291c35fc4c53659e9c6c: done: 0.018813 sec","job_status":"done","queue_duration_s":1.436849,"scheduling_latency_s":1.436865,"redis_calls":9,"redis_duration_s":0.002222,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018813,"completed_at":"2026-08-16T17:33:25.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2414gitlab # [ 428.819459] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"830340ac40857988846ab03c","created_at":"2026-08-16T17:33:24.057Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8473f68e7fb66a19e8f00a0d916a5c4","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.084Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-830340ac40857988846ab03c: start","job_status":"start","queue_duration_s":1.399028,"scheduling_latency_s":1.399046}2415gitlab # [ 428.861989] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"830340ac40857988846ab03c","created_at":"2026-08-16T17:33:24.057Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8473f68e7fb66a19e8f00a0d916a5c4","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.084Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-830340ac40857988846ab03c: done: 0.047455 sec","job_status":"done","queue_duration_s":1.399028,"scheduling_latency_s":1.399046,"redis_calls":28,"redis_duration_s":0.0068850000000000005,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001041,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000418,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.003996,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00143,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032528,"duration_s":0.047455,"completed_at":"2026-08-16T17:33:25.531Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2416gitlab # [ 428.934401] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a3c902521f21d0b7c2e58e38","created_at":"2026-08-16T17:33:24.116Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f85bee342e63f1c0bd7e3ead208521d5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.140Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a3c902521f21d0b7c2e58e38: start","job_status":"start","queue_duration_s":1.392144,"scheduling_latency_s":1.39216}2417gitlab # [ 428.959519] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a3c902521f21d0b7c2e58e38","created_at":"2026-08-16T17:33:24.116Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f85bee342e63f1c0bd7e3ead208521d5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.140Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a3c902521f21d0b7c2e58e38: done: 0.050607 sec","job_status":"done","queue_duration_s":1.392144,"scheduling_latency_s":1.39216,"redis_calls":11,"redis_duration_s":0.002873,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000524,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062504,"exclusive_lock_hold_duration_s":0.02795842,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.050607,"completed_at":"2026-08-16T17:33:25.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2418gitlab # [ 429.012776] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8a009c198c5c57cae410d098","created_at":"2026-08-16T17:33:24.177Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de902833a9ba7075fe5f484eafd6126d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.205Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8a009c198c5c57cae410d098: start","job_status":"start","queue_duration_s":1.379654,"scheduling_latency_s":1.37967}2419gitlab # [ 429.026921] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.596Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2420gitlab # [ 429.030775] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8a009c198c5c57cae410d098","created_at":"2026-08-16T17:33:24.177Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-e74e9846a8e54fe0","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de902833a9ba7075fe5f484eafd6126d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.205Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8a009c198c5c57cae410d098: done: 0.019885 sec","job_status":"done","queue_duration_s":1.379654,"scheduling_latency_s":1.37967,"redis_calls":9,"redis_duration_s":0.002261,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019885,"completed_at":"2026-08-16T17:33:25.604Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2421gitlab # [ 429.073020] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.606Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df4362db5d3e0e6bd4910147","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df4362db5d3e0e6bd4910147: start","job_status":"start","queue_duration_s":1.001179,"scheduling_latency_s":1.001195}2422gitlab # [ 429.085125] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.623Z","message":"No existing merge request to be cleaned up."}2423gitlab # [ 429.086743] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.638Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df4362db5d3e0e6bd4910147","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df4362db5d3e0e6bd4910147: done: 0.032817 sec","job_status":"done","queue_duration_s":1.001179,"scheduling_latency_s":1.001195,"redis_calls":12,"redis_duration_s":0.003669,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000989,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001596,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032817,"completed_at":"2026-08-16T17:33:25.638Z","load_balancing_strategy":"primary","db_duration_s":0.005919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424gitlab # [ 429.126364] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.640Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"659d59528451a07969cf0049","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-659d59528451a07969cf0049: start","job_status":"start","queue_duration_s":1.035252,"scheduling_latency_s":1.035268}2425gitlab # [ 429.138471] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.650Z","message":"No existing merge request to be cleaned up."}2426gitlab # [ 429.140133] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.659Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"659d59528451a07969cf0049","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-659d59528451a07969cf0049: done: 0.019589 sec","job_status":"done","queue_duration_s":1.035252,"scheduling_latency_s":1.035268,"redis_calls":10,"redis_duration_s":0.001473,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019589,"completed_at":"2026-08-16T17:33:25.659Z","load_balancing_strategy":"primary","db_duration_s":0.002614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2427gitlab # [ 429.179129] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.660Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bcff8d5fb29fdc62535af5e6","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bcff8d5fb29fdc62535af5e6: start","job_status":"start","queue_duration_s":1.055938,"scheduling_latency_s":1.055953}2428gitlab # [ 429.191473] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.672Z","message":"No existing merge request to be cleaned up."}2429gitlab # [ 429.193218] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.680Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bcff8d5fb29fdc62535af5e6","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bcff8d5fb29fdc62535af5e6: done: 0.019653 sec","job_status":"done","queue_duration_s":1.055938,"scheduling_latency_s":1.055953,"redis_calls":10,"redis_duration_s":0.00196,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000991,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019653,"completed_at":"2026-08-16T17:33:25.680Z","load_balancing_strategy":"primary","db_duration_s":0.002693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2430gitlab # [ 429.231412] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.682Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"08ab3fcb34a9a84fd215d3e4","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-08ab3fcb34a9a84fd215d3e4: start","job_status":"start","queue_duration_s":1.077324,"scheduling_latency_s":1.077339}2431gitlab # [ 429.244164] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.693Z","message":"No existing merge request to be cleaned up."}2432gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses2433gitlab # [ 429.246216] gitaly[894]: time="2026-08-16T17:33:25.994Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:55.891" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:25.992" grpc.time_ms=1.902 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2434gitlab # [ 429.258942] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.701Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"08ab3fcb34a9a84fd215d3e4","created_at":"2026-08-16T17:33:24.556Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-f725d1ec2fdf4b5e","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"207adc9fc96960c9575d131f08a94997","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:24.604Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-08ab3fcb34a9a84fd215d3e4: done: 0.019623 sec","job_status":"done","queue_duration_s":1.077324,"scheduling_latency_s":1.077339,"redis_calls":10,"redis_duration_s":0.0018960000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019623,"completed_at":"2026-08-16T17:33:25.701Z","load_balancing_strategy":"primary","db_duration_s":0.002603,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2435gitlab # [ 429.295082] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e629bfcbd26480675468c1d7","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e629bfcbd26480675468c1d7: start","job_status":"start","queue_duration_s":0.305728,"scheduling_latency_s":0.305744}2436gitlab # [ 429.308322] gitaly[894]: time="2026-08-16T17:33:26.059Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:36.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:26.042" grpc.time_ms=17.23 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2437gitlab # [ 429.322123] nixbot[3506]: {"ts": "2026-08-16T17:33:26.116Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 \"HTTP/1.1 201 Created\""}2438gitlab # [ 429.325272] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2412439gitlab # [ 429.327741] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e629bfcbd26480675468c1d7","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e629bfcbd26480675468c1d7: done: 0.035921 sec","job_status":"done","queue_duration_s":0.305728,"scheduling_latency_s":0.305744,"redis_calls":15,"redis_duration_s":0.01461,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000761,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006183,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007666,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035921,"completed_at":"2026-08-16T17:33:25.739Z","load_balancing_strategy":"primary","db_duration_s":0.000581,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2440gitlab # [ 429.370287] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.747Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"345b14e055f83c7f64134470","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-345b14e055f83c7f64134470: start","job_status":"start","queue_duration_s":0.349414,"scheduling_latency_s":0.349459}2441gitlab # [ 429.382863] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"345b14e055f83c7f64134470","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-345b14e055f83c7f64134470: done: 0.035713 sec","job_status":"done","queue_duration_s":0.349414,"scheduling_latency_s":0.349459,"redis_calls":13,"redis_duration_s":0.004115,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001437,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002678,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035713,"completed_at":"2026-08-16T17:33:25.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2442gitlab # [ 429.422366] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b702b1d8c09e2748bd7da3e","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b702b1d8c09e2748bd7da3e: start","job_status":"start","queue_duration_s":0.38742,"scheduling_latency_s":0.387452}2443gitlab # [ 429.434881] gitaly[894]: time="2026-08-16T17:33:26.194Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BQ8BND51T0W34J3D1VB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:56.192" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:26.193" grpc.time_ms=0.921 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2444gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses, in 0.20 seconds)2445gitlab # [ 429.447816] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b702b1d8c09e2748bd7da3e","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b702b1d8c09e2748bd7da3e: done: 0.028326 sec","job_status":"done","queue_duration_s":0.38742,"scheduling_latency_s":0.387452,"redis_calls":13,"redis_duration_s":0.0037990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002598,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028326,"completed_at":"2026-08-16T17:33:25.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2446gitlab # [ 429.487111] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"964a9384df82c088a959573a","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-964a9384df82c088a959573a: start","job_status":"start","queue_duration_s":0.418099,"scheduling_latency_s":0.418122}2447gitlab # [ 429.499660] gitaly[894]: time="2026-08-16T17:33:26.235Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BRWDWCAAB0JG2P1KSKS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:56.134" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:26.234" grpc.time_ms=0.594 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2448gitlab # [ 429.512794] nixbot[3506]: {"ts": "2026-08-16T17:33:26.304Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 \"HTTP/1.1 201 Created\""}2449gitlab # [ 429.515493] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"964a9384df82c088a959573a","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-964a9384df82c088a959573a: done: 0.023248 sec","job_status":"done","queue_duration_s":0.418099,"scheduling_latency_s":0.418122,"redis_calls":13,"redis_duration_s":0.0032830000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023248,"completed_at":"2026-08-16T17:33:25.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2450gitlab # [ 429.556204] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ace9e681ad69e8d8fc5cab7","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ace9e681ad69e8d8fc5cab7: start","job_status":"start","queue_duration_s":0.443165,"scheduling_latency_s":0.443185}2451gitlab # [ 429.568575] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 932452gitlab # [ 429.571117] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1852453gitlab # [ 429.573743] gitaly[894]: time="2026-08-16T17:33:26.251Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5BQ8BND51T0W34J3D1VB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:36.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:26.241" grpc.time_ms=9.883 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2454gitlab # [ 429.587444] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ace9e681ad69e8d8fc5cab7","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ace9e681ad69e8d8fc5cab7: done: 0.022092 sec","job_status":"done","queue_duration_s":0.443165,"scheduling_latency_s":0.443185,"redis_calls":13,"redis_duration_s":0.004349,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001168,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022092,"completed_at":"2026-08-16T17:33:25.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 429.627421] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c534c6084e4b72fa81490361","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c534c6084e4b72fa81490361: start","job_status":"start","queue_duration_s":0.467083,"scheduling_latency_s":0.467104}2456gitlab # [ 429.639864] gitaly[894]: time="2026-08-16T17:33:26.367Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BXBF7HPTKEZVEYZKVRD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:56.366" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:26.367" grpc.time_ms=0.454 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2457gitlab # [ 429.653048] nixbot[3506]: {"ts": "2026-08-16T17:33:26.452Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 \"HTTP/1.1 201 Created\""}2458gitlab # [ 429.655840] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c534c6084e4b72fa81490361","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c534c6084e4b72fa81490361: done: 0.025207 sec","job_status":"done","queue_duration_s":0.467083,"scheduling_latency_s":0.467104,"redis_calls":13,"redis_duration_s":0.003371,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025207,"completed_at":"2026-08-16T17:33:25.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2459gitlab # [ 429.695564] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74c3a722a97818233586be70","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74c3a722a97818233586be70: start","job_status":"start","queue_duration_s":0.494018,"scheduling_latency_s":0.494037}2460gitlab # [ 429.708402] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/95b5b88c7996170330c22dfac39ae3789732fb71 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1352461gitlab # [ 429.710886] gitaly[894]: time="2026-08-16T17:33:26.409Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5BXBF7HPTKEZVEYZKVRD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:33:36.026" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:26.396" grpc.time_ms=12.698 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2462gitlab # [ 429.724529] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74c3a722a97818233586be70","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74c3a722a97818233586be70: done: 0.018664 sec","job_status":"done","queue_duration_s":0.494018,"scheduling_latency_s":0.494037,"redis_calls":13,"redis_duration_s":0.0029950000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018664,"completed_at":"2026-08-16T17:33:25.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 429.764989] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67d46f8e3b3693e718387ac1","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67d46f8e3b3693e718387ac1: start","job_status":"start","queue_duration_s":0.514091,"scheduling_latency_s":0.514108}2464gitlab # [ 429.777721] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67d46f8e3b3693e718387ac1","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67d46f8e3b3693e718387ac1: done: 0.017588 sec","job_status":"done","queue_duration_s":0.514091,"scheduling_latency_s":0.514108,"redis_calls":13,"redis_duration_s":0.00373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017588,"completed_at":"2026-08-16T17:33:25.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2465gitlab # [ 429.817016] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1de81422767737c792de31de","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1de81422767737c792de31de: start","job_status":"start","queue_duration_s":0.533146,"scheduling_latency_s":0.533163}2466gitlab # [ 429.829802] nix-daemon[3715]: accepted connection from pid 4452, user nixbot2467gitlab # [ 429.830759] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1de81422767737c792de31de","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1de81422767737c792de31de: done: 0.017343 sec","job_status":"done","queue_duration_s":0.533146,"scheduling_latency_s":0.533163,"redis_calls":13,"redis_duration_s":0.0041530000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017343,"completed_at":"2026-08-16T17:33:25.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2468gitlab # [ 429.870396] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6637a93c3b58442f5ce835d4","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6637a93c3b58442f5ce835d4: start","job_status":"start","queue_duration_s":0.553008,"scheduling_latency_s":0.553025}2469gitlab # [ 429.883051] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6637a93c3b58442f5ce835d4","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6637a93c3b58442f5ce835d4: done: 0.017682 sec","job_status":"done","queue_duration_s":0.553008,"scheduling_latency_s":0.553025,"redis_calls":13,"redis_duration_s":0.002928,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017682,"completed_at":"2026-08-16T17:33:25.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2470gitlab # [ 429.922537] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a4eb53ae4b32effde8c7b6","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a4eb53ae4b32effde8c7b6: start","job_status":"start","queue_duration_s":0.572056,"scheduling_latency_s":0.572072}2471gitlab # [ 429.935069] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:26 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 662472gitlab # [ 429.937171] gitaly[894]: time="2026-08-16T17:33:26.669Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5C6AK19E616EHYWJ633K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:26.656" grpc.time_ms=11.809 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2473gitlab # [ 429.950342] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93a4eb53ae4b32effde8c7b6","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93a4eb53ae4b32effde8c7b6: done: 0.01648 sec","job_status":"done","queue_duration_s":0.572056,"scheduling_latency_s":0.572072,"redis_calls":13,"redis_duration_s":0.004089,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01648,"completed_at":"2026-08-16T17:33:25.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab # [ 429.990815] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:25.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1f5287a56f2b250d9eb5c00","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1f5287a56f2b250d9eb5c00: start","job_status":"start","queue_duration_s":0.59019,"scheduling_latency_s":0.590204}2475gitlab # [ 430.003440] gitaly[894]: time="2026-08-16T17:33:26.789Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5C8G6VSHY0VAB5W7KZZY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:26.768" pid=894 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2476gitlab # [ 430.013866] gitlab-workhorse[821]: time="2026-08-16T17:33:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672477gitlab # [ 430.015621] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/16:17:33:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1182478gitlab # [ 430.017593] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1f5287a56f2b250d9eb5c00","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1f5287a56f2b250d9eb5c00: done: 0.017291 sec","job_status":"done","queue_duration_s":0.59019,"scheduling_latency_s":0.590204,"redis_calls":13,"redis_duration_s":0.0046630000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017291,"completed_at":"2026-08-16T17:33:26.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2479gitlab # [ 430.057045] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59c3f58b6218cec21fa05344","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59c3f58b6218cec21fa05344: start","job_status":"start","queue_duration_s":0.608853,"scheduling_latency_s":0.60887}2480gitlab # [ 430.069339] gitaly[894]: time="2026-08-16T17:33:26.789Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5C8G6VSHY0VAB5W7KZZY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:26.768" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2481gitlab # [ 430.082753] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59c3f58b6218cec21fa05344","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59c3f58b6218cec21fa05344: done: 0.023425 sec","job_status":"done","queue_duration_s":0.608853,"scheduling_latency_s":0.60887,"redis_calls":13,"redis_duration_s":0.006114,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023425,"completed_at":"2026-08-16T17:33:26.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2482gitlab # [ 430.122159] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"659347bc469ec05e8a73316f","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-659347bc469ec05e8a73316f: start","job_status":"start","queue_duration_s":0.634832,"scheduling_latency_s":0.634858}2483gitlab # [ 430.134925] gitaly[894]: time="2026-08-16T17:33:26.790Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5C8G6VSHY0VAB5W7KZZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:33:26.768" grpc.time_ms=21.235 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc2484gitlab # [ 430.149694] nix-daemon[3715]: accepted connection from pid 4477, user nixbot2485gitlab # [ 430.150632] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"659347bc469ec05e8a73316f","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-659347bc469ec05e8a73316f: done: 0.024503 sec","job_status":"done","queue_duration_s":0.634832,"scheduling_latency_s":0.634858,"redis_calls":13,"redis_duration_s":0.0025329999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001555,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024503,"completed_at":"2026-08-16T17:33:26.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2486gitlab # [ 430.191358] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf73a68ac9321ff51a49511","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf73a68ac9321ff51a49511: start","job_status":"start","queue_duration_s":0.660873,"scheduling_latency_s":0.660932}2487gitlab # [ 430.203819] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf73a68ac9321ff51a49511","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf73a68ac9321ff51a49511: done: 0.018542 sec","job_status":"done","queue_duration_s":0.660873,"scheduling_latency_s":0.660932,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018542,"completed_at":"2026-08-16T17:33:26.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2488gitlab # [ 430.244261] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0012fd7ac93e17a3dd47ca22","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0012fd7ac93e17a3dd47ca22: start","job_status":"start","queue_duration_s":0.682636,"scheduling_latency_s":0.682657}2489gitlab # [ 430.256882] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0012fd7ac93e17a3dd47ca22","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0012fd7ac93e17a3dd47ca22: done: 0.020002 sec","job_status":"done","queue_duration_s":0.682636,"scheduling_latency_s":0.682657,"redis_calls":13,"redis_duration_s":0.003424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001135,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002289,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020002,"completed_at":"2026-08-16T17:33:26.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2490gitlab # [ 430.296526] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8e7a37095119c2af1e2568d","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8e7a37095119c2af1e2568d: start","job_status":"start","queue_duration_s":0.704095,"scheduling_latency_s":0.704113}2491gitlab # [ 430.309181] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8e7a37095119c2af1e2568d","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8e7a37095119c2af1e2568d: done: 0.01927 sec","job_status":"done","queue_duration_s":0.704095,"scheduling_latency_s":0.704113,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01927,"completed_at":"2026-08-16T17:33:26.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab # [ 430.349212] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0fa743ec8b80a9823cf80c8","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0fa743ec8b80a9823cf80c8: start","job_status":"start","queue_duration_s":0.724761,"scheduling_latency_s":0.724779}2493gitlab # [ 430.361738] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d0fa743ec8b80a9823cf80c8","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d0fa743ec8b80a9823cf80c8: done: 0.016012 sec","job_status":"done","queue_duration_s":0.724761,"scheduling_latency_s":0.724779,"redis_calls":13,"redis_duration_s":0.001988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016012,"completed_at":"2026-08-16T17:33:26.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2494gitlab # [ 430.401984] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bd4e8faf1cefc600a5e0fb4","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bd4e8faf1cefc600a5e0fb4: start","job_status":"start","queue_duration_s":0.741963,"scheduling_latency_s":0.741981}2495gitlab # [ 430.414660] gitaly[894]: time="2026-08-16T17:33:27.131Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:27.129" grpc.time_ms=1.532 pid=894 span.kind=server system=grpc2496gitlab # [ 430.425159] gitaly[894]: time="2026-08-16T17:33:27.173Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:27.172" grpc.time_ms=1.033 pid=894 span.kind=server system=grpc2497gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses2498gitlab # [ 430.434937] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bd4e8faf1cefc600a5e0fb4","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bd4e8faf1cefc600a5e0fb4: done: 0.016372 sec","job_status":"done","queue_duration_s":0.741963,"scheduling_latency_s":0.741981,"redis_calls":13,"redis_duration_s":0.0019219999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016372,"completed_at":"2026-08-16T17:33:26.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2499gitlab # [ 430.473834] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.157Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d4ec6f3f2df097dc6d3de1c","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d4ec6f3f2df097dc6d3de1c: start","job_status":"start","queue_duration_s":0.759537,"scheduling_latency_s":0.759553}2500gitlab # [ 430.485250] gitaly[894]: time="2026-08-16T17:33:27.221Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:33:27.220" grpc.time_ms=0.779 pid=894 span.kind=server system=grpc2501gitlab # [ 430.494025] gitaly[894]: time="2026-08-16T17:33:27.228Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:57.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:27.075" operations="[repack_refs]" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2502gitlab # [ 430.503033] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d4ec6f3f2df097dc6d3de1c","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d4ec6f3f2df097dc6d3de1c: done: 0.015409 sec","job_status":"done","queue_duration_s":0.759537,"scheduling_latency_s":0.759553,"redis_calls":13,"redis_duration_s":0.002074,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015409,"completed_at":"2026-08-16T17:33:26.173Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2503gitlab # [ 430.542754] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab622966c9a30587d4d0e5d2","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab622966c9a30587d4d0e5d2: start","job_status":"start","queue_duration_s":0.776382,"scheduling_latency_s":0.776399}2504gitlab # [ 430.555471] gitaly[894]: time="2026-08-16T17:33:27.234Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y diskcache=ffd04081-ab11-4450-b40c-83f8f9c0bc9a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:57.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:27.075" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2505gitlab # [ 430.565626] gitaly[894]: time="2026-08-16T17:33:27.234Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=171 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7230 command.oublock=0 command.real_time_ms=151 command.spawn_token_fork_ms=1 command.system_time_ms=92 command.user_time_ms=79 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:57.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:27.075" grpc.time_ms=159.058 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2506gitlab # [ 430.581251] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab622966c9a30587d4d0e5d2","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab622966c9a30587d4d0e5d2: done: 0.014681 sec","job_status":"done","queue_duration_s":0.776382,"scheduling_latency_s":0.776399,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014681,"completed_at":"2026-08-16T17:33:26.189Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2507gitlab # [ 430.621012] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0963a452dc49b6ff64e38bc","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0963a452dc49b6ff64e38bc: start","job_status":"start","queue_duration_s":0.792185,"scheduling_latency_s":0.792202}2508gitlab # [ 430.633597] gitaly[894]: time="2026-08-16T17:33:27.234Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:57.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:27.075" pid=894 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 17:31:42.13054618 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2509gitlab # [ 430.645875] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0963a452dc49b6ff64e38bc","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0963a452dc49b6ff64e38bc: done: 0.015251 sec","job_status":"done","queue_duration_s":0.792185,"scheduling_latency_s":0.792202,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015251,"completed_at":"2026-08-16T17:33:26.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2510gitlab # [ 430.685368] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17cabf05de220e22fdf93bb9","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17cabf05de220e22fdf93bb9: start","job_status":"start","queue_duration_s":0.808549,"scheduling_latency_s":0.808567}2511gitlab # [ 430.697572] gitaly[894]: time="2026-08-16T17:33:27.278Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:57.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:27.075" pid=894 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2512gitlab # [ 430.711053] gitaly[894]: time="2026-08-16T17:33:27.279Z" level=info msg="optimized repository" clean_stale_data_time=43.77508ms clean_work_trees_time="161.2µs" commit_graph_time=900ns correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="2.18µs" pid=894 prune_time=360ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.86µs" storage_name=default system=housekeeping total_time=44.02822ms2513gitlab # [ 430.717271] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17cabf05de220e22fdf93bb9","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17cabf05de220e22fdf93bb9: done: 0.014874 sec","job_status":"done","queue_duration_s":0.808549,"scheduling_latency_s":0.808567,"redis_calls":13,"redis_duration_s":0.001784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014874,"completed_at":"2026-08-16T17:33:26.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2514gitlab # [ 430.756915] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93de855908a8961d327525e1","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93de855908a8961d327525e1: start","job_status":"start","queue_duration_s":0.824872,"scheduling_latency_s":0.824921}2515gitlab # [ 430.769435] gitaly[894]: time="2026-08-16T17:33:27.279Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:33:57.074" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:33:27.075" pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2516gitlab # [ 430.779520] gitaly[894]: time="2026-08-16T17:33:27.350Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:33:57.347" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:27.348" grpc.time_ms=1.541 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2517gitlab # [ 430.792644] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93de855908a8961d327525e1","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93de855908a8961d327525e1: done: 0.014934 sec","job_status":"done","queue_duration_s":0.824872,"scheduling_latency_s":0.824921,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014934,"completed_at":"2026-08-16T17:33:26.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2518gitlab # [ 430.832136] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"398c65ffd988e2ef6ffbd61f","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-398c65ffd988e2ef6ffbd61f: start","job_status":"start","queue_duration_s":0.840963,"scheduling_latency_s":0.84098}2519gitlab # [ 430.844480] gitaly[894]: time="2026-08-16T17:33:27.406Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5BFHNDZJZ5XFRM9ARG9Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:57.403" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:27.404" grpc.time_ms=1.125 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2520gitlab # [ 430.856867] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"398c65ffd988e2ef6ffbd61f","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-398c65ffd988e2ef6ffbd61f: done: 0.01622 sec","job_status":"done","queue_duration_s":0.840963,"scheduling_latency_s":0.84098,"redis_calls":13,"redis_duration_s":0.001931,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01622,"completed_at":"2026-08-16T17:33:26.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2521gitlab # [ 430.896397] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b8bdebd260cbd2fd5f0643b","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b8bdebd260cbd2fd5f0643b: start","job_status":"start","queue_duration_s":0.864779,"scheduling_latency_s":0.864797}2522gitlab # [ 430.908544] gitaly[894]: time="2026-08-16T17:33:27.556Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05T5CYB05TCMS6FFNBQM9T3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:33:57.553" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:33:27.555" grpc.time_ms=1.217 pid=894 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2523gitlab # [ 430.921537] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b8bdebd260cbd2fd5f0643b","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b8bdebd260cbd2fd5f0643b: done: 0.015031 sec","job_status":"done","queue_duration_s":0.864779,"scheduling_latency_s":0.864797,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015031,"completed_at":"2026-08-16T17:33:26.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2524gitlab # [ 430.960851] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3eacde36607916f5c0ea72f","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3eacde36607916f5c0ea72f: start","job_status":"start","queue_duration_s":0.880973,"scheduling_latency_s":0.88099}2525gitlab # [ 430.973282] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3eacde36607916f5c0ea72f","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3eacde36607916f5c0ea72f: done: 0.01471 sec","job_status":"done","queue_duration_s":0.880973,"scheduling_latency_s":0.88099,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01471,"completed_at":"2026-08-16T17:33:26.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2526gitlab # [ 431.013548] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff56e9f12db17fe53e278e0","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff56e9f12db17fe53e278e0: start","job_status":"start","queue_duration_s":0.896942,"scheduling_latency_s":0.896961}2527gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/95b5b88c7996170330c22dfac39ae3789732fb71/statuses, in 0.57 seconds)2528(finished: subtest: eval and build post commit statuses, in 6.71 seconds)2529(finished: run the VM test script, in 503.18 seconds)2530gitlab # [ 431.025330] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ff56e9f12db17fe53e278e0","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ff56e9f12db17fe53e278e0: done: 0.015545 sec","job_status":"done","queue_duration_s":0.896942,"scheduling_latency_s":0.896961,"redis_calls":13,"redis_duration_s":0.0015970000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015545,"completed_at":"2026-08-16T17:33:26.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2531test script finished in 503.22s2532cleanup2533kill QemuMachine (pid 46)2534gitlab # [ 431.066024] sidekiq-cluster[3452]: {"severity":"INFO","time":"2026-08-16T17:33:26.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ddca744e8a82809d3f797b6","created_at":"2026-08-16T17:33:25.203Z","trace_propagation_headers":{"sentry-trace":"2ff9a87a1342453b9ca0ef329280917c-7e8d78fd9c084b25","baggage":"sentry-trace_id=2ff9a87a1342453b9ca0ef329280917c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"687c96a4d0ccddafc77c9b069f28f4cd","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:33:25.398Z","job_size_bytes":2,"pid":3452,"sidekiq_tid":"m8lc","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ddca744e8a82809d3f797b6: start","job_status":"start","queue_duration_s":0.913569,"scheduling_latency_s":0.913585}2535gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2536(finished: cleanup, in 1.34 seconds)2537additionally exposed symbols:2538 gitlab,2539 vlan1,2540 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2541[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T17:31:48.038Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2542[]2543[]2544[]2545[]2546[]2547[]2548[]2549[]2550[]2551[]2552[]2553[]2554[]2555[]2556[]2557[]2558[]2559[]2560[]2561[]2562[]2563[]2564[]2565[]2566[]2567[]2568[]2569[]2570[]2571[]2572[]2573[]2574[]2575[]2576[]2577[]2578[]2579[]2580[]2581[]2582[]2583[]2584[]2585[]2586[]2587[]2588[]2589[]2590[]2591[]2592[]2593[]2594[]2595[]2596[]2597[]2598[]2599[]2600[]2601[]2602[]2603[]2604[]2605[]2606[]2607[]2608[]2609[]2610[]2611[]2612[]2613[]2614[]2615[]2616[]2617[]2618[]2619[]2620[]2621[]2622[]2623[]2624[]2625[]2626[]2627[]2628[]2629[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T17:33:20.286775Z', 'started_at': '2026-08-16T17:33:20.660700Z', 'finished_at': None}]2630[{'id': 5, 'sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:33:20.620Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2631[{'id': 5, 'sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:33:20.620Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2632[{'id': 5, 'sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:33:20.620Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2633[{'id': 5, 'sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:33:20.620Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2634[{'id': 5, 'sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T17:33:20.620Z', 'started_at': None, 'finished_at': '2026-08-16T17:33:26.086Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2635[{'id': 5, 'sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T17:33:20.620Z', 'started_at': None, 'finished_at': '2026-08-16T17:33:26.086Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '95b5b88c7996170330c22dfac39ae3789732fb71', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-16T17:33:26.277Z', 'started_at': None, 'finished_at': '2026-08-16T17:33:26.428Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]