vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #314
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10(finished: start all VMs, in 95.93 seconds)11gitlab # Disk image does not exist, creating the virtualisation disk image...12gitlab # Formatting '/build/vm-state-gitlab/tmp.khQlXDxeqq', fmt=raw size=107374182413gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab # Discarding device blocks: 0/262144 done15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab # Filesystem UUID: 5442f546-3bde-488d-abd9-c2c185f769b317gitlab # Superblock backups stored on blocks:18gitlab # 32768, 98304, 163840, 22937619gitlab # 20gitlab # Allocating group tables: 0/8 done21gitlab # Writing inode tables: 0/8 done22gitlab # Creating journal (8192 blocks): done23gitlab # Writing superblocks and filesystem accounting information: 0/8 done24gitlab # 25gitlab # Virtualisation disk image created.26gitlab # Creating Nix store image...27gitlab # Created Nix store image.28gitlab: waiting for unit setup-gitlab.service29gitlab: waiting for the VM to finish booting30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/kkp1ri3f1qddy3hiav99g2cwbgh9571j-nixos-system-gitlab-test/init regInfo=/nix/store/q9xgcr3ks1vyx5j6bdj9530h4gbp958g-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/q9xgcr3ks1vyx5j6bdj9530h4gbp958g-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000036] arm-pv: using stolen time PV108gitlab # [ 0.000426] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000672] Console: colour dummy device 80x25110gitlab # [ 0.000708] printk: legacy console [tty0] enabled111gitlab # [ 0.000907] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000914] pid_max: default: 32768 minimum: 301113gitlab # [ 0.001007] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001155] landlock: Up and running.115gitlab # [ 0.001159] Yama: becoming mindful.116gitlab # [ 0.001639] LSM support for eBPF active117gitlab # [ 0.001850] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001987] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.003390] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.004157] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.004162] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.004327] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.005515] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.005622] EFI services will not be available.125gitlab # [ 0.005798] smp: Bringing up secondary CPUs ...126gitlab # [ 0.006317] Detected PIPT I-cache on CPU1127gitlab # [ 0.006362] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006409] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006464] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007254] Detected PIPT I-cache on CPU2131gitlab # [ 0.007285] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007328] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007369] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008046] Detected PIPT I-cache on CPU3135gitlab # [ 0.008079] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008122] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008161] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.008465] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.008494] SMP: Total of 4 processors activated.140gitlab # [ 0.008497] CPU: All CPU(s) started at EL1141gitlab # [ 0.008507] CPU features: detected: Branch Target Identification142gitlab # [ 0.008511] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.008514] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.008518] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.008522] CPU features: detected: Common not Private translations146gitlab # [ 0.008525] CPU features: detected: CRC32 instructions147gitlab # [ 0.008528] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.008532] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.008535] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.008538] CPU features: detected: E0PD151gitlab # [ 0.008540] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.008543] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.008546] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.008550] CPU features: detected: Fine Grained Traps155gitlab # [ 0.008553] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.008557] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.008560] CPU features: detected: LSE atomic instructions158gitlab # [ 0.008563] CPU features: detected: Privileged Access Never159gitlab # [ 0.008566] CPU features: detected: PMUv3160gitlab # [ 0.008568] CPU features: detected: RAS Extension Support161gitlab # [ 0.008571] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.008573] CPU features: detected: Random Number Generator163gitlab # [ 0.008576] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.008579] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.008581] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.008585] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.028779] alternatives: applying system-wide alternatives168gitlab # [ 0.048763] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.049134] Memory: 5963744K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.050867] devtmpfs: initialized171gitlab # [ 0.086846] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.086939] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.087186] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.087194] 0 pages in range for non-PLT usage175gitlab # [ 0.087195] 508288 pages in range for PLT usage176gitlab # [ 0.087374] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.088354] DMI not present or invalid.178gitlab # [ 0.092225] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.096535] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.097055] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.099093] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.099143] audit: initializing netlink subsys (disabled)183gitlab # [ 0.100082] thermal_sys: Registered thermal governor 'fair_share'184gitlab # [ 0.100086] thermal_sys: Registered thermal governor 'bang_bang'185gitlab # [ 0.100091] thermal_sys: Registered thermal governor 'step_wise'186gitlab # [ 0.100094] thermal_sys: Registered thermal governor 'user_space'187gitlab # [ 0.100096] thermal_sys: Registered thermal governor 'power_allocator'188gitlab # [ 0.100224] audit: type=2000 audit(0.076:1): state=initialized audit_enabled=0 res=1189gitlab # [ 0.100281] cpuidle: using governor ladder190gitlab # [ 0.100356] cpuidle: using governor menu191gitlab # [ 0.100608] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.100818] ASID allocator initialised with 65536 entries193gitlab # [ 0.102278] Serial: AMBA PL011 UART driver194gitlab # [ 0.108050] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.108519] printk: console [ttyAMA0] enabled196gitlab # [ 0.157027] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.157042] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.157045] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.157048] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.157051] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.157054] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.157057] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.157060] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.204382] fbcon: Taking over console205gitlab # [ 0.204410] ACPI: Interpreter disabled.206gitlab # [ 0.206891] iommu: Default domain type: Translated207gitlab # [ 0.206900] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.237611] SCSI subsystem initialized209gitlab # [ 0.238532] usbcore: registered new interface driver usbfs210gitlab # [ 0.238611] usbcore: registered new interface driver hub211gitlab # [ 0.238630] usbcore: registered new device driver usb212gitlab # [ 0.239050] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.239055] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.239064] PTP clock support registered215gitlab # [ 0.239118] EDAC MC: Ver: 3.0.0216gitlab # [ 0.239822] scmi_core: SCMI protocol bus registered217gitlab # [ 0.240579] FPGA manager framework218gitlab # [ 0.242253] vgaarb: loaded219gitlab # [ 0.262406] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.264258] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.264298] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.269807] netfs: FS-Cache loaded223gitlab # [ 0.270043] pnp: PnP ACPI: disabled224gitlab # [ 0.275030] NET: Registered PF_INET protocol family225gitlab # [ 0.276523] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.312669] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.312970] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.313055] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.313442] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.314105] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.314903] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.315003] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.315178] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.315442] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.315522] NET: Registered PF_XDP protocol family236gitlab # [ 0.315542] PCI: CLS 0 bytes, default 64237gitlab # [ 0.319970] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.339839] kvm [1]: HYP mode not available239gitlab # [ 0.447659] Initialise system trusted keyrings240gitlab # [ 0.460828] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.466935] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.467060] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.482382] Key type asymmetric registered244gitlab # [ 0.482412] Asymmetric key parser 'x509' registered245gitlab # [ 0.482586] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.483006] io scheduler mq-deadline registered247gitlab # [ 0.483026] io scheduler kyber registered248gitlab # [ 0.492088] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.502358] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.503202] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.503282] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.503319] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.503329] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.503363] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.503397] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.503507] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.503518] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.503526] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.503531] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.503536] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.503677] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.504208] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.504411] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.504429] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.504461] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.504478] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.504999] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.505197] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.505215] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.505247] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.511503] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.512500] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.512515] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.512542] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.513467] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.513656] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.513667] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.513693] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.514170] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.514390] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.514402] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.514427] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.514958] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.515151] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.515163] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.515189] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.515686] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.515877] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.515889] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.515915] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.515928] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.516438] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.516630] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.516657] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.523590] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.523796] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.523823] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.526114] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.527063] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.527789] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.528049] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.528061] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.528088] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.528596] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.533441] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.533469] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.533496] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.534354] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.534364] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.534368] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.534419] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.534468] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.534514] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.534559] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.534613] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.534660] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.534706] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.534753] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.534807] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.534922] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.536623] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.536655] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.536851] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.536893] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.536913] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.536933] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.536953] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.536973] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.536993] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.537013] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.537040] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.537061] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.537079] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.537097] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.537115] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.537133] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.537150] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.537168] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.537186] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.537204] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.537223] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.537253] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.537260] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.537263] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.538638] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.583203] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.618409] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.637099] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.639977] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.649070] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.652083] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.658480] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.669894] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.685411] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.691691] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.695456] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.729345] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.733723] msm_serial: driver initialized359gitlab # [ 0.733949] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.734008] STM32 USART driver initialized361gitlab # [ 0.789723] loop: module loaded362gitlab # [ 0.790102] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.794360] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.798690] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.802868] virtio_blk virtio5: [vdb] 12284328 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.810107] megasas: 07.734.00.00-rc1367gitlab # [ 0.811071] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.822331] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.822488] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.827181] Using buffer write method371gitlab # [ 0.827283] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.833664] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.833705] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.844207] Using buffer write method375gitlab # [ 0.844279] Concatenating MTD devices:376gitlab # [ 0.844284] (0): "0.flash"377gitlab # [ 0.844289] (1): "0.flash"378gitlab # [ 0.844293] into device "0.flash"379gitlab # [ 1.091056] Freeing initrd memory: 27184K380gitlab # [ 1.101285] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 1.107108] thunder_xcv, ver 1.0382gitlab # [ 1.107183] thunder_bgx, ver 1.0383gitlab # [ 1.107209] nicpf, ver 1.0384gitlab # [ 1.107873] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 1.107882] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 1.107919] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 1.107930] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 1.107958] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 1.107964] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 1.107988] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 1.107994] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 1.108146] sky2: driver version 1.30393gitlab # [ 1.110544] usbcore: registered new interface driver usb-storage394gitlab # [ 1.110769] usbcore: registered new interface driver usbserial_generic395gitlab # [ 1.110784] usbserial: USB Serial support registered for generic396gitlab # [ 1.111530] hv_vmbus: registering driver hyperv_keyboard397gitlab # [ 1.113576] ehci-pci 0000:00:0a.0: EHCI Host Controller398gitlab # [ 1.113624] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1399gitlab # [ 1.114147] rtc-pl031 9010000.pl031: registered as rtc0400gitlab # [ 1.114187] rtc-pl031 9010000.pl031: setting system clock to 2026-09-04T07:38:59 UTC (1788507539)401gitlab # [ 1.114441] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000402gitlab # [ 1.115469] i2c_dev: i2c /dev entries driver403gitlab # [ 1.121066] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 1.121076] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 1.121344] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 1.121722] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 1.123855] hid: raw HID events driver (C) Jiri Kosina408gitlab # [ 1.124195] usbcore: registered new interface driver usbhid409gitlab # [ 1.124199] usbhid: USB HID core driver410gitlab # [ 1.128073] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available411gitlab # [ 1.130076] drop_monitor: Initializing network drop monitor service412gitlab # [ 1.132996] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00413gitlab # [ 1.133907] NET: Registered PF_INET6 protocol family414gitlab # [ 1.134691] hub 1-0:1.0: USB hub found415gitlab # [ 1.134727] hub 1-0:1.0: 6 ports detected416gitlab # [ 1.136375] Segment Routing with IPv6417gitlab # [ 1.136413] In-situ OAM (IOAM) with IPv6418gitlab # [ 1.136507] NET: Registered PF_PACKET protocol family419gitlab # [ 1.136638] 9pnet: Installing 9P2000 support420gitlab # [ 1.145597] Key type dns_resolver registered421gitlab # [ 1.152134] registered taskstats version 1422gitlab # [ 1.152404] Loading compiled-in X.509 certificates423gitlab # [ 1.161070] Demotion targets for Node 0: null424gitlab # [ 1.161320] Key type .fscrypt registered425gitlab # [ 1.161325] Key type fscrypt-provisioning registered426gitlab # [ 1.161475] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 1.161497] ima: Allocated hash algorithm: sha1428gitlab # [ 1.161531] ima: No architecture policies found429gitlab # [ 1.162964] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 1.203245] clk: Disabling unused clocks431gitlab # [ 1.203304] PM: genpd: Disabling unused power domains432gitlab # [ 1.211858] Freeing unused kernel memory: 4736K433gitlab # [ 1.212170] Run /init as init process434gitlab # [ 1.276139] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 1.390400] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.557684] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.610778] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.614354] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.614408] systemd[1]: Detected architecture arm64.440gitlab # [ 1.614415] systemd[1]: Running in initrd.441gitlab # [ 1.614880] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.615010] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.684044] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.802409] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.845222] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.943527] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.966244] systemd[1]: Created slice Slice /system/modprobe.448gitlab # [ 1.966525] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.449gitlab # [ 1.966564] systemd[1]: Expecting device /dev/disk/by-label/nix-store...450gitlab # [ 1.966580] systemd[1]: Expecting device /dev/disk/by-label/nixos...451gitlab # [ 1.966612] systemd[1]: Reached target Path Units.452gitlab # [ 1.966628] systemd[1]: Reached target Slice Units.453gitlab # [ 1.966649] systemd[1]: Reached target Swaps.454gitlab # [ 1.966667] systemd[1]: Reached target Timer Units.455gitlab # [ 1.966851] systemd[1]: Listening on D-Bus System Message Bus Socket.456gitlab # [ 1.967000] systemd[1]: Listening on Journal Socket (/dev/log).457gitlab # [ 1.967119] systemd[1]: Listening on Journal Sockets.458gitlab # [ 1.967236] systemd[1]: Listening on udev Control Socket.459gitlab # [ 1.967312] systemd[1]: Listening on udev Kernel Socket.460gitlab # [ 1.967331] systemd[1]: Reached target Socket Units.461gitlab # [ 1.977215] systemd[1]: Starting Create List of Static Device Nodes...462gitlab # [ 2.001131] systemd[1]: Starting Load Kernel Module 9pnet_virtio...463gitlab # [ 2.001266] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs464gitlab # [ 2.024941] systemd[1]: Mounting Kernel Configuration File System...465gitlab # [ 2.049011] systemd[1]: Starting Journal Service...466gitlab # [ 2.052800] systemd[1]: Starting Load Kernel Modules...467gitlab # [ 2.052972] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os468gitlab # [ 2.054761] systemd[1]: Starting Coldplug All udev Devices...469gitlab # [ 2.056605] systemd[1]: Finished Create List of Static Device Nodes.470gitlab # [ 2.057205] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2471gitlab # [ 2.057434] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0472gitlab # [ 2.063615] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 2.064037] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 2.064418] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 2.092834] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 2.283786] hrtimer: interrupt took 116001140 ns477gitlab # [ 2.293499] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.478gitlab # [ 2.293949] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev479gitlab # [ 2.304586] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 2.307187] [drm] features: -virgl +edid -resource_blob -host_visible481gitlab # [ 2.307213] [drm] features: -context_init482gitlab # [ 2.308574] [drm] number of scanouts: 1483gitlab # [ 2.308613] [drm] number of cap sets: 0484gitlab # [ 2.315765] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.485gitlab # [ 2.326809] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic486gitlab # [ 2.326849] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0487gitlab # [ 2.337556] systemd[1]: Starting Create Static Device Nodes in /dev...488gitlab # [ 2.344551] systemd-journald[95]: Collecting audit messages is disabled.489gitlab # [ 2.375706] Console: switching to colour frame buffer device 160x50490gitlab # [ 2.376404] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device491gitlab # [ 2.416968] systemd[1]: Finished Create Static Device Nodes in /dev.492gitlab # [ 2.417353] systemd[1]: Reached target Preparation for Local File Systems.493gitlab # [ 2.417415] systemd[1]: Reached target Local File Systems.494gitlab # [ 2.449127] systemd[1]: Starting Rule-based Manager for Device Events and Files...495gitlab # [ 2.450166] systemd[1]: Finished Load Kernel Modules.496gitlab # [ 2.478541] systemd[1]: Starting Apply Kernel Variables...497gitlab # [ 2.554435] systemd[1]: Started Journal Service.498gitlab # [ 2.480684] systemd-modules-load[96]: Using 4 probe threads499gitlab # [ 2.502420] systemd-modules-load[96]: Module 'virtio_balloon' is built in500gitlab # [ 2.504811] systemd-modules-load[96]: Module 'virtio_console' is built in501gitlab # [ 2.506429] systemd-modules-load[96]: Module 'virtio_rng' is built in502gitlab # [ 2.507985] systemd-modules-load[96]: Inserted module 'dm_mod'503gitlab # [ 2.509342] systemd-modules-load[96]: Inserted module 'virtio_gpu'504gitlab # [ 2.514837] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 2.527609] systemd[1]: Starting Create System Files and Directories...506gitlab # [ 2.567254] systemd-udevd[105]: Using default interface naming scheme 'v261'.507gitlab # [ 2.586638] systemd[1]: Finished Create System Files and Directories.508gitlab # [ 2.607626] systemd[1]: Started Rule-based Manager for Device Events and Files.509gitlab # [ 2.666899] systemd[1]: Starting Virtual Console Setup...510gitlab # [ 2.731023] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones.511gitlab # [ 2.735383] systemd[1]: Finished Virtual Console Setup.512gitlab # [ 3.057490] systemd[1]: Finished Coldplug All udev Devices.513gitlab # [ 3.067087] systemd[1]: Reached target System Initialization.514gitlab # [ 3.068421] systemd[1]: Reached target Basic System.515gitlab # [ 3.419243] (udev-worker)[148]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 3.428520] (udev-worker)[148]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 3.448223] (udev-worker)[129]: Network interface NamePolicy= disabled on kernel command line.518gitlab # [ 3.516266] systemd[1]: Found device /dev/disk/by-label/nix-store.519gitlab # [ 3.600866] systemd[1]: Found device /dev/disk/by-label/nixos.520gitlab # [ 3.612895] systemd[1]: Reached target Initrd Root Device.521gitlab # [ 3.620214] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...522gitlab # [ 3.748984] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks523gitlab # [ 3.787819] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.524gitlab # [ 3.815795] systemd[1]: Mounting /sysroot...525gitlab # [ 4.039056] EXT4-fs (vda): mounted filesystem 5442f546-3bde-488d-abd9-c2c185f769b3 r/w with ordered data mode. Quota mode: none.526gitlab # [ 3.976591] systemd[1]: Mounted /sysroot.527gitlab # [ 3.978390] systemd[1]: Reached target Initrd Root File System.528gitlab # [ 3.987696] systemd[1]: Starting Mountpoints Configured in the Real Root...529gitlab # [ 4.021070] systemd[1]: Mounting /sysroot/nix/.ro-store...530gitlab # [ 4.034205] systemd-sysroot-fstab-check[161]: /sysroot should be mounted in the initrd, will request daemon-reload.531gitlab # [ 4.048344] systemd[1]: Mounting /sysroot/nix/.rw-store...532gitlab # [ 4.070901] systemd[1]: Mounting /sysroot/run...533gitlab # [ 4.086672] systemd[1]: Mounting /sysroot/tmp/shared...534gitlab # [ 4.160329] systemd[1]: Mounting /sysroot/tmp/xchg...535gitlab # [ 4.161548] systemd[1]: Mounted /sysroot/nix/.rw-store.536gitlab # [ 4.164687] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 4.168326] systemd[1]: Mounted /sysroot/run.538gitlab # [ 4.169177] systemd[1]: Reload requested from client PID 161 ('systemd-sysroot') (unit initrd-parse-etc.service)...539gitlab # [ 4.174913] systemd[1]: Reloading...540gitlab # [ 4.256923] erofs (device vdb): mounted with root inode @ nid 128.541gitlab # [ 4.595687] systemd[1]: Reloading finished in 422 ms.542gitlab # [ 4.708201] systemd-sysroot-fstab-check[161]: Requesting initrd-fs.target/start/replace...543gitlab # [ 4.718668] systemd[1]: Mounted /sysroot/nix/.ro-store.544gitlab # [ 4.719776] systemd[1]: Mounted /sysroot/tmp/shared.545gitlab # [ 4.720630] systemd[1]: Mounted /sysroot/tmp/xchg.546gitlab # [ 4.721365] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.547gitlab # [ 4.722933] systemd[1]: Finished rw-sysroot-nix-store.service.548gitlab # [ 4.726682] systemd-sysroot-fstab-check[161]: Requesting swap.target/start/replace...549gitlab # [ 4.733364] systemd[1]: Starting rw-sysroot-nix-store.service...550gitlab # [ 4.738633] systemd[1]: initrd-parse-etc.service: Deactivated successfully.551gitlab # [ 4.767292] systemd[1]: Finished Mountpoints Configured in the Real Root.552gitlab # [ 4.768662] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.553gitlab # [ 4.828147] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.554gitlab # [ 4.830375] systemd[1]: Finished rw-sysroot-nix-store.service.555gitlab # [ 4.842790] systemd[1]: Mounting /sysroot/nix/store...556gitlab # [ 4.937344] systemd[1]: Mounted /sysroot/nix/store.557gitlab # [ 4.939821] systemd[1]: Reached target Initrd File Systems.558gitlab # [ 4.944328] systemd[1]: Starting Find NixOS closure...559gitlab # [ 4.988438] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...560gitlab # [ 5.032511] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.561gitlab # [ 5.035621] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.562gitlab # [ 5.050796] systemd[1]: Finished Find NixOS closure.563gitlab # [ 5.053688] systemd[1]: Reached target Initrd Default Target.564gitlab # [ 5.069390] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...565gitlab # [ 5.104315] systemd[1]: Stopped target Initrd Default Target.566gitlab # [ 5.112270] systemd[1]: Stopped target Basic System.567gitlab # [ 5.139576] systemd[1]: Stopped target Initrd Root Device.568gitlab # [ 5.145442] systemd[1]: Stopped target Path Units.569gitlab # [ 5.146267] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.570gitlab # [ 5.151601] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.571gitlab # [ 5.157074] systemd[1]: Stopped target Slice Units.572gitlab # [ 5.160632] systemd[1]: Stopped target Socket Units.573gitlab # [ 5.163535] systemd[1]: Stopped target System Initialization.574gitlab # [ 5.166328] systemd[1]: Stopped target Swaps.575gitlab # [ 5.171287] systemd[1]: Stopped target Timer Units.576gitlab # [ 5.175770] systemd[1]: dbus.socket: Deactivated successfully.577gitlab # [ 5.181819] systemd[1]: Closed D-Bus System Message Bus Socket.578gitlab # [ 5.188741] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.579gitlab # [ 5.196714] systemd[1]: Stopped Find NixOS closure.580gitlab # [ 5.199630] systemd[1]: Starting Load Kernel Module 9pnet_virtio...581gitlab # [ 5.201218] systemd[1]: Starting rw-sysroot-nix-store.service...582gitlab # [ 5.202518] systemd[1]: systemd-sysctl.service: Deactivated successfully.583gitlab # [ 5.203918] systemd[1]: Stopped Apply Kernel Variables.584gitlab # [ 5.205063] systemd[1]: systemd-modules-load.service: Deactivated successfully.585gitlab # [ 5.206579] systemd[1]: Stopped Load Kernel Modules.586gitlab # [ 5.207713] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.587gitlab # [ 5.210239] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.588gitlab # [ 5.211358] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.589gitlab # [ 5.212801] systemd[1]: Stopped Create System Files and Directories.590gitlab # [ 5.213784] systemd[1]: Stopped target Local File Systems.591gitlab # [ 5.222753] systemd[1]: Stopped target Preparation for Local File Systems.592gitlab # [ 5.226246] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.593gitlab # [ 5.229968] systemd[1]: Stopped Coldplug All udev Devices.594gitlab # [ 5.234914] systemd[1]: Stopping Rule-based Manager for Device Events and Files...595gitlab # [ 5.236450] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.596gitlab # [ 5.238155] systemd[1]: Stopped Virtual Console Setup.597gitlab # [ 5.238940] systemd[1]: initrd-cleanup.service: Deactivated successfully.598gitlab # [ 5.239864] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.599gitlab # [ 5.242118] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.600gitlab # [ 5.243198] systemd[1]: Finished Load Kernel Module 9pnet_virtio.601gitlab # [ 5.248797] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.602gitlab # [ 5.253806] systemd[1]: Finished rw-sysroot-nix-store.service.603gitlab # [ 5.259150] systemd[1]: systemd-udevd.service: Deactivated successfully.604gitlab # [ 5.260193] systemd[1]: Stopped Rule-based Manager for Device Events and Files.605gitlab # [ 5.261176] systemd[1]: systemd-udevd.service: Consumed 2.815s CPU time over 2.871s wall clock time, 25M memory peak.606gitlab # [ 5.267000] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.607gitlab # [ 5.269560] systemd[1]: Closed udev Control Socket.608gitlab # [ 5.272635] systemd[1]: Starting Cleanup udev Database...609gitlab # [ 5.275081] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.610gitlab # [ 5.279230] systemd[1]: Stopped Create Static Device Nodes in /dev.611gitlab # [ 5.280581] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.612gitlab # [ 5.283993] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.613gitlab # [ 5.285906] systemd[1]: kmod-static-nodes.service: Deactivated successfully.614gitlab # [ 5.290348] systemd[1]: Stopped Create List of Static Device Nodes.615gitlab # [ 5.339412] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.616gitlab # [ 5.347181] systemd[1]: Finished Cleanup udev Database.617gitlab # [ 5.348054] systemd[1]: Reached target Switch Root.618gitlab # [ 5.349961] systemd[1]: Starting NixOS Activation...619gitlab # [ 5.632735] initrd-nixos-activation-start[218]: booting system configuration /nix/store/kkp1ri3f1qddy3hiav99g2cwbgh9571j-nixos-system-gitlab-test620gitlab # [ 5.727155] initrd-nixos-activation-start[218]: running activation script...621gitlab # [ 6.258570] initrd-nixos-activation-start[241]: setting up /etc...622gitlab # [ 6.420296] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.623gitlab # [ 6.421650] systemd[1]: Finished NixOS Activation.624gitlab # [ 6.427207] systemd[1]: Starting Switch Root...625gitlab # [ 6.460825] systemd[1]: Switching root.626gitlab # [ 6.673719] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).627gitlab # [ 7.492189] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)628gitlab # [ 7.492273] systemd[1]: Detected virtualization qemu.629gitlab # [ 7.492340] systemd[1]: Detected architecture arm64.630gitlab # [ 7.492458] systemd[1]: Detected first boot.631gitlab # [ 7.493254] systemd[1]: Initializing machine ID from random generator.632gitlab # [ 7.726978] systemd[1]: bpf-restrict-fs: LSM BPF program attached633gitlab # [ 7.891433] systemd[1]: Applying preset policy.634gitlab # [ 8.220816] systemd[1]: Populated /etc with preset unit settings.635gitlab # [ 8.506821] systemd[1]: initrd-switch-root.service: Deactivated successfully.636gitlab # [ 8.508863] systemd[1]: Stopped initrd-switch-root.service.637gitlab # [ 8.512414] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.638gitlab # [ 8.529491] systemd[1]: Created slice Slice /system/getty.639gitlab # [ 8.535406] systemd[1]: Created slice GitLab DevOps Platform Slice.640gitlab # [ 8.545453] systemd[1]: Created slice User and Session Slice.641gitlab # [ 8.551061] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.642gitlab # [ 8.553401] systemd[1]: Started Forward Password Requests to Wall Directory Watch.643gitlab # [ 8.553927] systemd[1]: Expecting device /dev/hvc0...644gitlab # [ 8.559486] systemd[1]: Expecting device /dev/ttyAMA0...645gitlab # [ 8.560085] systemd[1]: Reached target Local Encrypted Volumes.646gitlab # [ 8.560522] systemd[1]: Stopped target initrd-fs.target.647gitlab # [ 8.565705] systemd[1]: Stopped target initrd-root-fs.target.648gitlab # [ 8.566589] systemd[1]: Stopped target initrd-switch-root.target.649gitlab # [ 8.567110] systemd[1]: Reached target Virtual Machines and Containers.650gitlab # [ 8.567522] systemd[1]: Reached target Path Units.651gitlab # [ 8.567894] systemd[1]: Reached target Remote File Systems.652gitlab # [ 8.568251] systemd[1]: Reached target Slice Units.653gitlab # [ 8.568591] systemd[1]: Reached target Swaps.654gitlab # [ 8.574135] systemd[1]: Listening on Query the User Interactively for a Password.655gitlab # [ 8.576879] systemd[1]: Listening on Process Core Dump Socket.656gitlab # [ 8.580477] systemd[1]: Listening on Credential Encryption/Decryption.657gitlab # [ 8.585441] systemd[1]: Listening on Factory Reset Management.658gitlab # [ 8.586412] systemd[1]: Listening on Hostname Service Socket.659gitlab # [ 8.598729] systemd[1]: Starting Journal Log Access Socket...660gitlab # [ 8.603168] systemd[1]: Listening on Journal Audit Socket.661gitlab # [ 8.605712] systemd[1]: Listening on Console Output Muting Service Socket.662gitlab # [ 8.606547] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.663gitlab # [ 8.607018] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os664gitlab # [ 8.612069] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki665gitlab # [ 8.617440] systemd[1]: Listening on Disk Repartitioning Service Socket.666gitlab # [ 8.618145] systemd[1]: Listening on udev Control Socket.667gitlab # [ 8.622586] systemd[1]: Listening on udev Varlink Socket.668gitlab # [ 8.658952] systemd[1]: Mounting Huge Pages File System...669gitlab # [ 8.677928] systemd[1]: Mounting POSIX Message Queue File System...670gitlab # [ 8.688262] systemd[1]: Mounting Kernel Debug File System...671gitlab # [ 8.706704] systemd[1]: Mounting Kernel Trace File System...672gitlab # [ 8.721446] systemd[1]: Starting Create List of Static Device Nodes...673gitlab # [ 8.738524] systemd[1]: Starting Load Kernel Module 9pnet_virtio...674gitlab # [ 8.741615] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs675gitlab # [ 8.773111] systemd[1]: Mounting Kernel Configuration File System...676gitlab # [ 8.773982] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm677gitlab # [ 8.774681] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore678gitlab # [ 8.805004] systemd[1]: Starting Load Kernel Module fuse...679gitlab # [ 8.807245] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67680gitlab # [ 8.846146] systemd[1]: Starting Journal Service...681gitlab # [ 8.862543] systemd[1]: Starting Load Kernel Modules...682gitlab # [ 8.885263] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...683gitlab # [ 8.896974] fuse: init (API version 7.45)684gitlab # [ 8.917327] systemd[1]: Starting Remount Root and Kernel File Systems...685gitlab # [ 8.918493] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os686gitlab # [ 8.930976] systemd[1]: Starting Coldplug All udev Devices...687gitlab # [ 8.939686] systemd[1]: Listening on Journal Log Access Socket.688gitlab # [ 8.944637] systemd[1]: Mounted Huge Pages File System.689gitlab # [ 8.953464] systemd[1]: Mounted POSIX Message Queue File System.690gitlab # [ 8.957404] systemd[1]: Mounted Kernel Debug File System.691gitlab # [ 8.958684] systemd[1]: Mounted Kernel Trace File System.692gitlab # [ 8.967657] systemd[1]: Finished Create List of Static Device Nodes.693gitlab # [ 8.979235] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.694gitlab # [ 8.980193] systemd[1]: Finished Load Kernel Module 9pnet_virtio.695gitlab # [ 8.985299] systemd[1]: Mounted Kernel Configuration File System.696gitlab # [ 8.986199] systemd[1]: modprobe@fuse.service: Deactivated successfully.697gitlab # [ 8.990274] systemd[1]: Finished Load Kernel Module fuse.698gitlab # [ 9.034284] systemd[1]: Mounting FUSE Control File System...699gitlab # [ 9.046508] systemd-journald[313]: Collecting audit messages is enabled.700gitlab # [ 9.053184] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...701gitlab # [ 9.054957] systemd[1]: Finished Load Kernel Modules.702gitlab # [ 9.065140] EXT4-fs (vda): re-mounted 5442f546-3bde-488d-abd9-c2c185f769b3.703gitlab # [ 9.101185] systemd[1]: Starting Firewall...704gitlab # [ 9.144501] systemd[1]: Starting Apply Kernel Variables...705gitlab # [ 9.070225] systemd[1]: Queued start job for default target Multi-User System.706gitlab # [ 9.156513] systemd[1]: Started Journal Service.707gitlab # [ 9.097158] systemd[1]: Unnecessary job was removed for /dev/vdb.708gitlab # [ 9.147233] systemd[1]: systemd-journald.service: Deactivated successfully.709gitlab # [ 9.148798] systemd-modules-load[315]: Using 3 probe threads710gitlab # [ 9.149828] systemd-modules-load[315]: Module 'atkbd' is built in711gitlab # [ 9.167176] systemd-modules-load[315]: Module 'loop' is built in712gitlab # [ 9.212694] systemd-modules-load[315]: Inserted module 'tls'713gitlab # [ 9.219395] systemd[1]: Finished Remount Root and Kernel File Systems.714gitlab # [ 9.305414] systemd-journald[313]: Received client request to flush runtime journal.715gitlab # [ 9.453018] systemd[1]: Mounted FUSE Control File System.716gitlab # [ 9.454647] systemd[1]: Listening on Disk Image Download Service Socket.717gitlab # [ 9.458360] systemd[1]: Starting Flush Journal to Persistent Storage...718gitlab # [ 9.464311] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore719gitlab # [ 9.474974] systemd[1]: Starting Load/Save OS Random Seed...720gitlab # [ 9.484335] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os721gitlab # [ 9.495785] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.722gitlab # [ 9.503499] systemd[1]: Finished Apply Kernel Variables.723gitlab # [ 9.507374] systemd[1]: Finished Load/Save OS Random Seed.724gitlab # [ 9.514165] systemd[1]: Reached target First Boot Complete.725gitlab # [ 9.518173] systemd-oomd[316]: No swap; memory pressure usage will be degraded726gitlab # [ 9.523643] systemd[1]: Starting Create Static Device Nodes in /dev...727gitlab # [ 9.527226] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.728gitlab # [ 9.532822] systemd[1]: Finished Create Static Device Nodes in /dev.729gitlab # [ 9.537891] systemd[1]: Reached target Preparation for Local File Systems.730gitlab # [ 9.547453] systemd[1]: Starting Rule-based Manager for Device Events and Files...731gitlab # [ 9.549317] systemd[1]: Mounting /run/wrappers...732gitlab # [ 9.551105] systemd[1]: Finished Flush Journal to Persistent Storage.733gitlab # [ 9.556523] systemd[1]: Mounted /run/wrappers.734gitlab # [ 9.557737] systemd[1]: Reached target Local File Systems.735gitlab # [ 9.564207] systemd[1]: Listening on Boot Loader Control Service Socket.736gitlab # [ 9.572580] systemd[1]: Starting register-nix-paths.service...737gitlab # [ 9.573607] systemd[1]: Starting Create SUID/SGID Wrappers...738gitlab # [ 9.580142] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.739gitlab # [ 9.606688] systemd[1]: Starting Save Transient machine-id to Disk...740gitlab # [ 9.664114] systemd[1]: Starting Create System Files and Directories...741gitlab # [ 9.876544] systemd[1]: Finished Create System Files and Directories.742gitlab # [ 9.879538] systemd-udevd[346]: Using default interface naming scheme 'v261'.743gitlab # [ 9.924483] systemd[1]: Starting Rebuild Journal Catalog...744gitlab # [ 10.123811] systemd[1]: Starting Record System Boot/Shutdown in UTMP...745gitlab # [ 10.125139] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.746gitlab # [ 10.133601] systemd[1]: Finished Save Transient machine-id to Disk.747gitlab # [ 10.221872] systemd[1]: Finished Record System Boot/Shutdown in UTMP.748gitlab # [ 10.276315] systemd[1]: Started Rule-based Manager for Device Events and Files.749gitlab # [ 10.399758] systemd[1]: Finished Rebuild Journal Catalog.750gitlab # [ 10.409098] systemd[1]: Starting Update is Completed...751gitlab # [ 10.466052] systemd[1]: Finished Update is Completed.752gitlab # [ 10.506749] systemd[1]: Finished Coldplug All udev Devices.753gitlab # [ 10.564149] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.754gitlab # [ 10.565471] systemd[1]: Finished Create SUID/SGID Wrappers.755gitlab # [ 10.571580] systemd[1]: suid-sgid-wrappers.service: Consumed 303ms CPU time over 1.022s wall clock time, 5.8M memory peak, 1.9M read from disk.756gitlab # [ 10.905062] systemd[1]: Finished Firewall.757gitlab # [ 11.388340] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3758gitlab # [ 11.401524] systemd[1]: Finished register-nix-paths.service.759gitlab # [ 11.410985] systemd[1]: Reached target System Initialization.760gitlab # [ 11.413027] systemd[1]: Started Discard unused filesystem blocks once a week.761gitlab # [ 11.416930] systemd[1]: Started logrotate.timer.762gitlab # [ 11.419220] systemd[1]: Started Daily Cleanup of Temporary Directories.763gitlab # [ 11.420212] systemd[1]: Reached target Timer Units.764gitlab # [ 11.420934] systemd[1]: Listening on D-Bus System Message Bus Socket.765gitlab # [ 11.421795] systemd[1]: Listening on Nix Daemon Socket.766gitlab # [ 11.454667] systemd[1]: Starting nixbot CI service socket...767gitlab # [ 11.459827] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.768gitlab # [ 11.466757] systemd[1]: Listening on nixbot CI service socket.769gitlab # [ 11.482570] systemd[1]: Reached target Socket Units.770gitlab # [ 11.495445] systemd[1]: Starting D-Bus System Message Bus...771gitlab # [ 11.506705] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs772gitlab # [ 11.525028] systemd[1]: Starting Virtual Console Setup...773gitlab # [ 11.674615] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.774gitlab # [ 11.719088] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.775gitlab # [ 11.746061] (udev-worker)[516]: Network interface NamePolicy= disabled on kernel command line.776gitlab # [ 11.807865] dbus-broker-launch[560]: Looking up NSS user entry for 'systemd-timesync'...777gitlab # [ 11.815931] dbus-broker-launch[560]: NSS returned no entry for 'systemd-timesync'778gitlab # [ 11.817090] dbus-broker-launch[560]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"779gitlab # [ 11.839424] (udev-worker)[513]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.780gitlab # [ 11.846858] (udev-worker)[513]: Network interface NamePolicy= disabled on kernel command line.781gitlab # [ 11.858937] systemd[1]: Started D-Bus System Message Bus.782gitlab # [ 11.873269] dbus-broker-launch[560]: Ready783gitlab # [ 11.888506] systemd[1]: Reached target Basic System.784gitlab # [ 11.912519] systemd[1]: Started backdoor.service.785gitlab # [ 11.927019] systemd[1]: Starting gitlab-config.service...786gitlab # [ 11.993851] systemd[1]: Starting Import lastlog data into lastlog2 database...787gitlab # [ 12.004557] systemd[1]: Starting Logrotate configuration check...788gitlab # connecting to host...789gitlab # [ 12.040085] systemd-vconsole-setup[561]: Configuration of first virtual console was skipped, ignoring remaining ones.790gitlab # [ 12.068310] systemd[1]: Starting Name Service Cache Daemon (nsncd)...791gitlab: Guest shell says: b'Spawning backdoor root shell...\n'792gitlab # [ 12.085595] systemd[1]: Starting Post-Boot Actions...793gitlab # [ 12.165800] mousedev: PS/2 mouse device common for all mice794gitlab: connected to guest root shell795gitlab: (connecting took 12.65 seconds)796gitlab: (finished: waiting for the VM to finish booting, in 12.65 seconds)797gitlab # [ 12.111142] logrotate[576]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.798gitlab # [ 12.121795] logrotate[576]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf799gitlab # [ 12.129169] logrotate[576]: note: 'monthly' overrides previously specified 'weekly'800gitlab # [ 12.130269] logrotate[576]: Reading state from file: /var/lib/logrotate.status801gitlab # [ 12.138827] logrotate[576]: state file /var/lib/logrotate.status does not exist802gitlab # [ 12.141815] logrotate[576]: Allocating hash table for state file, size 64 entries803gitlab # [ 12.142841] logrotate[576]: Handling 4 logs804gitlab # [ 12.143403] logrotate[576]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed805gitlab # [ 12.145912] logrotate[576]: considering log /var/log/btmp806gitlab # [ 12.150818] logrotate[576]: Creating new state807gitlab # [ 12.152403] logrotate[576]: Now: 2026-09-04 07:39808gitlab # [ 12.156397] logrotate[576]: Last rotated at 2026-09-04 07:00809gitlab # [ 12.158636] logrotate[576]: log does not need rotating (log has already been rotated)810gitlab # [ 12.162791] logrotate[576]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed811gitlab # [ 12.175932] logrotate[576]: considering log /var/log/wtmp812gitlab # [ 12.177514] logrotate[576]: Creating new state813gitlab # [ 12.178566] logrotate[576]: Now: 2026-09-04 07:39814gitlab # [ 12.179667] logrotate[576]: Last rotated at 2026-09-04 07:00815gitlab # [ 12.180873] logrotate[576]: log does not need rotating (log has already been rotated)816gitlab # [ 12.190361] logrotate[576]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed817gitlab # [ 12.196234] logrotate[576]: switching euid from 0 to 165 and egid from 0 to 165 (pid 576)818gitlab # [ 12.198169] logrotate[576]: considering log /var/gitlab/state/log/*.log819gitlab # [ 12.199818] logrotate[576]: log /var/gitlab/state/log/*.log does not exist -- skipping820gitlab # [ 12.204381] logrotate[576]: Creating new state821gitlab # [ 12.205618] logrotate[576]: switching euid from 165 to 0 and egid from 165 to 0 (pid 576)822gitlab # [ 12.207289] logrotate[576]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed823gitlab # [ 12.209911] logrotate[576]: switching euid from 0 to 60 and egid from 0 to 60 (pid 576)824gitlab # [ 12.211485] logrotate[576]: considering log /var/log/nginx/*.log825gitlab # [ 12.212721] logrotate[576]: log /var/log/nginx/*.log does not exist -- skipping826gitlab # [ 12.214225] logrotate[576]: Creating new state827gitlab # [ 12.215194] logrotate[576]: not running postrotate script, since no logs were rotated828gitlab # [ 12.220414] logrotate[576]: switching euid from 60 to 0 and egid from 60 to 0 (pid 576)829gitlab # [ 12.221944] systemd[1]: Started Reset console on configuration changes.830gitlab # [ 12.223871] systemd[1]: Starting resolvconf update...831gitlab # [ 12.225455] systemd[1]: Finished Virtual Console Setup.832gitlab # [ 12.227002] systemd[1]: Started Name Service Cache Daemon (nsncd).833gitlab # [ 12.232250] systemd[1]: Finished Logrotate configuration check.834gitlab # [ 12.233660] systemd[1]: Finished Post-Boot Actions.835gitlab # [ 12.234787] systemd[1]: Condition check resulted in Virtio network device being skipped.836gitlab # [ 12.250675] systemd[1]: Finished Import lastlog data into lastlog2 database.837gitlab # [ 12.258725] systemd[1]: Reached target Host and Network Name Lookups.838gitlab # [ 12.259908] systemd[1]: Reached target User and Group Name Lookups.839gitlab # [ 12.266444] nsncd[578]: Sep 04 07:39:10.725 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"840gitlab # [ 12.298679] systemd[1]: Starting User Login Management...841gitlab # [ 12.627464] systemd-logind[612]: New seat seat0.842gitlab # [ 12.643118] systemd-logind[612]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)843gitlab # [ 12.651463] systemd-logind[612]: Watching system buttons on /dev/input/event0 (gpio-keys)844gitlab # [ 12.654708] systemd[1]: Started User Login Management.845gitlab # [ 12.659826] systemd[1]: Starting linger-users.service...846gitlab # [ 12.664281] systemd[1]: Stopped target Host and Network Name Lookups.847gitlab # [ 12.671947] systemd[1]: Stopping Host and Network Name Lookups...848gitlab # [ 12.673529] systemd[1]: Stopped target User and Group Name Lookups.849gitlab # [ 12.674855] systemd[1]: Stopping User and Group Name Lookups...850gitlab # [ 12.678317] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...851gitlab # [ 12.679310] systemd[1]: nscd.service: Deactivated successfully.852gitlab # [ 12.680832] systemd[1]: Stopped Name Service Cache Daemon (nsncd).853gitlab # [ 12.681771] systemd[1]: nscd.service: Consumed 45ms CPU time over 612ms wall clock time, 7.6M memory peak, 5.8M read from disk.854gitlab # [ 12.718277] systemd[1]: Starting Name Service Cache Daemon (nsncd)...855gitlab # [ 12.729391] systemd[1]: linger-users.service: Deactivated successfully.856gitlab # [ 12.731270] systemd[1]: Finished linger-users.service.857gitlab # [ 12.755692] systemd[1]: Started Name Service Cache Daemon (nsncd).858gitlab # [ 12.762229] nsncd[668]: Sep 04 07:39:11.217 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"859gitlab # [ 12.768155] systemd[1]: Reached target Host and Network Name Lookups.860gitlab # [ 12.770098] systemd[1]: Reached target User and Group Name Lookups.861gitlab # [ 12.809048] systemd[1]: Finished resolvconf update.862gitlab # [ 12.816188] systemd[1]: Reached target Preparation for Network.863gitlab # [ 12.836261] systemd[1]: Starting DHCP Client...864gitlab # [ 12.849418] systemd[1]: Starting Address configuration of eth1...865gitlab # [ 12.888993] systemd[1]: Starting Extra networking commands....866gitlab # [ 13.067160] network-addresses-eth1-start[691]: adding address 192.168.1.1/24... done867gitlab # [ 13.098815] network-addresses-eth1-start[691]: adding address 2001:db8:1::1/64... done868gitlab # [ 13.118805] systemd[1]: Finished Address configuration of eth1.869gitlab # [ 13.258615] systemd[1]: Finished Extra networking commands..870gitlab # [ 13.266574] systemd[1]: Reached target Network.871gitlab # [ 13.286746] systemd[1]: Starting gitlab-workhorse.service...872gitlab # [ 13.330420] systemd[1]: Starting Nginx Web Server...873gitlab # [ 13.353008] systemd[1]: Starting PostgreSQL Server...874gitlab # [ 13.377962] dhcpcd[729]: dhcpcd-10.3.2 starting875gitlab # [ 13.388399] systemd[1]: Starting Redis Server - redis-gitlab...876gitlab # [ 13.395776] dhcpcd[784]: dev: loaded udev877gitlab # [ 13.398511] systemd[1]: Starting Permit User Sessions...878gitlab # [ 13.520737] systemd[1]: Finished Permit User Sessions.879gitlab # [ 13.613697] 8021q: 802.1Q VLAN Support v1.8880gitlab # [ 13.614468] 8021q: adding VLAN 0 to HW filter on device eth1881gitlab # [ 13.566239] systemd[1]: Started Getty on tty1.882gitlab # [ 13.567666] systemd[1]: Reached target Login Prompts.883gitlab # [ 14.154021] nginx-pre-start[816]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok884gitlab # [ 14.158037] nginx-pre-start[816]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful885gitlab # [ 14.197216] systemd[1]: Started Nginx Web Server.886gitlab # [ 14.278758] postgresql-pre-start[818]: The files belonging to this database system will be owned by user "postgres".887gitlab # [ 14.280498] postgresql-pre-start[818]: This user must also own the server process.888gitlab # [ 14.321865] postgresql-pre-start[818]: The database cluster will be initialized with locale "en_US.UTF-8".889gitlab # [ 14.339297] postgresql-pre-start[818]: The default database encoding has accordingly been set to "UTF8".890gitlab # [ 14.348416] postgresql-pre-start[818]: The default text search configuration will be set to "english".891gitlab # [ 14.355701] postgresql-pre-start[818]: Data page checksums are enabled.892gitlab # [ 14.359469] postgresql-pre-start[818]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok893gitlab # [ 14.368209] postgresql-pre-start[818]: creating subdirectories ... ok894gitlab # [ 14.374705] postgresql-pre-start[818]: selecting dynamic shared memory implementation ... posix895gitlab # [ 14.379208] redis-server[812]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.896gitlab # [ 14.392741] systemd[1]: Started Redis Server - redis-gitlab.897gitlab # [ 14.395239] redis-server[812]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo898gitlab # [ 14.403350] redis-server[812]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=812, just started899gitlab # [ 14.411761] redis-server[812]: Configuration loaded900gitlab # [ 14.413570] redis[812]: monotonic clock: ARM CNTVCT @ 1000 ticks/us901gitlab # [ 14.419438] redis[812]: Running mode=standalone, port=0.[ 14.494989] cfg80211: Loading compiled-in X.509 certificates for regulatory database902gitlab # 903gitlab # [ 14.430903] redis[812]: Server initialized904gitlab # [ 14.431774] redis[812]: Ready to accept connections unix905gitlab # [ 14.432760] redis[812]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.906gitlab # [ 14.534657] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'907gitlab # [ 14.537073] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'908gitlab # [ 14.543234] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2909gitlab # [ 14.543763] cfg80211: failed to load regulatory.db910gitlab # [ 14.568388] postgresql-pre-start[818]: selecting default "max_connections" ... 100911gitlab # [ 14.752800] 8021q: adding VLAN 0 to HW filter on device eth0912gitlab # [ 14.696658] dhcpcd[784]: eth0: waiting for carrier913gitlab # [ 14.698174] dhcpcd[784]: libudev: received NULL device914gitlab # [ 14.699298] dhcpcd[784]: libudev: received NULL device915gitlab # [ 14.709880] dhcpcd[784]: eth0: carrier acquired916gitlab # [ 14.710959] postgresql-pre-start[818]: selecting default "shared_buffers" ... 128MB917gitlab # [ 14.747390] dhcpcd[784]: DUID 00:01:00:01:32:2d:32:21:52:54:00:12:34:56918gitlab # [ 14.749525] dhcpcd[784]: eth0: IAID 00:12:34:56919gitlab # [ 14.750895] dhcpcd[784]: eth0: adding address fe80::5054:ff:fe12:3456920gitlab # [ 15.138643] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.921gitlab # [ 15.140315] systemd[1]: Stopped Virtual Console Setup.922gitlab # [ 15.141177] systemd[1]: systemd-vconsole-setup.service: Consumed 72ms CPU time over 3.613s wall clock time, 2.9M memory peak, 1.1M read from disk.923gitlab # [ 15.142918] systemd[1]: Stopping Virtual Console Setup...924gitlab # [ 15.156710] systemd[1]: Starting Virtual Console Setup...925gitlab # [ 15.179462] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.926gitlab # [ 15.187118] systemd[1]: Stopped Virtual Console Setup.927gitlab # [ 15.225853] systemd[1]: Starting Virtual Console Setup...928gitlab # [ 15.282594] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.929gitlab # [ 15.308841] systemd-vconsole-setup[863]: Configuration of first virtual console was skipped, ignoring remaining ones.930gitlab # [ 15.315597] systemd-logind[612]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)931gitlab # [ 15.325824] systemd[1]: Finished Virtual Console Setup.932gitlab # [ 15.967374] systemd[1]: Started gitlab-workhorse.service.933gitlab # [ 16.099281] dhcpcd[784]: eth0: soliciting an IPv6 router934gitlab # [ 16.101008] dhcpcd[784]: eth0: Router Advertisement from fe80::2935gitlab # [ 16.102378] dhcpcd[784]: eth0: adding address fec0::5054:ff:fe12:3456/64936gitlab # [ 16.108730] dhcpcd[784]: eth0: adding route to fec0::/64937gitlab # [ 16.109932] dhcpcd[784]: eth0: adding default route via fe80::2938gitlab # [ 16.166228] postgresql-pre-start[818]: selecting default time zone ... UTC939gitlab # [ 16.171556] postgresql-pre-start[818]: creating configuration files ... ok940gitlab # [ 16.535297] gitlab-workhorse[871]: time="2026-09-04T07:39:14Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4941gitlab # [ 16.540251] gitlab-workhorse[871]: time="2026-09-04T07:39:14Z" level=info msg="Using redis/go-redis"942gitlab # [ 16.542071] gitlab-workhorse[871]: time="2026-09-04T07:39:14Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix943gitlab # [ 16.597728] postgresql-pre-start[818]: running bootstrap script ... ok944gitlab # [ 16.614046] dhcpcd[784]: eth0: soliciting a DHCP lease945gitlab # [ 16.629684] dhcpcd[784]: eth0: offered 10.0.2.15 from 10.0.2.2946gitlab # [ 16.650866] dhcpcd[784]: eth0: probing address 10.0.2.15/24947gitlab # [ 17.696764] postgresql-pre-start[818]: performing post-bootstrap initialization ... ok948gitlab # [ 18.545694] postgresql-pre-start[818]: syncing data to disk ... ok949gitlab # [ 18.545939] postgresql-pre-start[818]: initdb: warning: enabling "trust" authentication for local connections950gitlab # [ 18.545987] postgresql-pre-start[818]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.951gitlab # [ 18.546070] postgresql-pre-start[818]: Success. You can now start the database server using:952gitlab # [ 18.546106] postgresql-pre-start[818]: pg_ctl -D /var/lib/postgresql/18 -l logfile start953gitlab # [ 18.875246] postgres[917]: [917] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit954gitlab # [ 18.882621] postgres[917]: [917] LOG: listening on IPv6 address "::1", port 5432955gitlab # [ 18.886495] postgres[917]: [917] LOG: listening on IPv4 address "127.0.0.1", port 5432956gitlab # [ 18.893701] postgres[917]: [917] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"957gitlab # [ 18.938861] postgres[927]: [927] LOG: database system was shut down at 2026-09-04 07:39:16 GMT958gitlab # [ 18.968249] postgres[917]: [917] LOG: database system is ready to accept connections959gitlab # [ 19.023030] systemd[1]: Started PostgreSQL Server.960gitlab # [ 19.043357] systemd[1]: Starting PostgreSQL Setup Scripts...961gitlab # [ 20.111143] postgresql-setup-start[938]: CREATE DATABASE962gitlab # [ 20.220311] postgresql-setup-start[957]: CREATE ROLE963gitlab # [ 20.270225] postgresql-setup-start[959]: ALTER DATABASE964gitlab # [ 20.346962] postgresql-setup-start[964]: CREATE ROLE965gitlab # [ 20.359157] systemd[1]: Finished PostgreSQL Setup Scripts.966gitlab # [ 20.361397] systemd[1]: Reached target PostgreSQL.967gitlab # [ 20.371928] systemd[1]: Starting gitlab-postgresql.service...968gitlab # [ 20.446665] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[952]: mkdir -p /var/gitlab/state/home/.ssh: OK969gitlab # [ 20.456215] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[952]: chmod 700 /var/gitlab/state/home/.ssh: OK970gitlab # [ 20.566726] systemd[1]: Finished gitlab-config.service.971gitlab # [ 20.582632] systemd[1]: Started gitaly.service.972gitlab # [ 20.593274] systemd[1]: Starting gitlab-db-config.service...973gitlab # [ 20.731082] gitlab-postgresql-start[976]: CREATE DATABASE974gitlab # [ 20.839222] gitlab-postgresql-start[1002]: CREATE EXTENSION975gitlab # [ 21.075824] gitlab-postgresql-start[1004]: CREATE EXTENSION976gitlab # [ 21.098641] systemd[1]: Finished gitlab-postgresql.service.977gitlab # [ 21.514910] dhcpcd[784]: eth0: leased 10.0.2.15 for 86400 seconds978gitlab # [ 21.556830] dhcpcd[784]: eth0: adding route to 10.0.2.0/24979gitlab # [ 21.564962] dhcpcd[784]: eth0: adding default route via 10.0.2.2980gitlab # [ 21.666872] gitaly[986]: time="2026-09-04T07:39:20.125Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=986981gitlab # [ 21.680871] gitaly[986]: time="2026-09-04T07:39:20.126Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=986982gitlab # [ 21.683316] gitaly[986]: time="2026-09-04T07:39:20.130Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=986983gitlab # [ 21.700530] gitaly[986]: time="2026-09-04T07:39:20.130Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=986984gitlab # [ 21.703298] gitaly[986]: time="2026-09-04T07:39:20.130Z" level=info msg="Starting Gitaly" pid=986 version=985gitlab # [ 22.018183] systemd[1]: Started DHCP Client.986gitlab # [ 22.019681] systemd[1]: Reached target Network is Online.987gitlab # [ 22.199602] gitaly[986]: time="2026-09-04T07:39:20.658Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=527 pid=986988gitlab # [ 22.204004] gitaly[986]: time="2026-09-04T07:39:20.658Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=986989gitlab # [ 22.208077] gitaly[986]: time="2026-09-04T07:39:20.659Z" level=info msg="finished initializing command factory" duration_ms=0 pid=986990gitlab # [ 22.210621] gitaly[986]: time="2026-09-04T07:39:20.659Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-986/git-exec-2648056597.d/git pid=986991gitlab # [ 22.226529] gitaly[986]: time="2026-09-04T07:39:20.682Z" level=info msg="finished detecting git version" duration_ms=22 pid=986992gitlab # [ 22.229478] gitaly[986]: time="2026-09-04T07:39:20.683Z" level=info msg="using Git version" pid=986 version=2.53.g993gitlab # [ 22.237691] gitaly[986]: time="2026-09-04T07:39:20.683Z" level=info msg="clearing disk cache object folder" pid=986 storage=default994gitlab # [ 22.241611] gitaly[986]: time="2026-09-04T07:39:20.683Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4112710420 pid=986 storage=default995gitlab # [ 22.263658] gitaly[986]: time="2026-09-04T07:39:20.683Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4112710420 pid=986 storage=default996gitlab # [ 22.286034] gitaly[986]: time="2026-09-04T07:39:20.683Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=986997gitlab # [ 22.300786] gitaly[986]: time="2026-09-04T07:39:20.683Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=986998gitlab # [ 22.305699] gitaly[986]: time="2026-09-04T07:39:20.683Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4112710420 clear_duration_ms=0 pid=986 storage=default999gitlab # [ 22.340484] gitaly[986]: time="2026-09-04T07:39:20.800Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9861000gitlab # [ 22.348811] gitaly[986]: time="2026-09-04T07:39:20.804Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=986 schema=unix1001gitlab # [ 22.354130] gitaly[986]: time="2026-09-04T07:39:20.804Z" level=info msg="listening at address" address=/run/gitaly/gitaly-986/sock.d/intern pid=986 schema=unix1002gitlab # [ 22.368630] gitaly[986]: time="2026-09-04T07:39:20.800Z" level=info msg="counting repositories" pid=9861003gitlab # [ 22.374253] gitaly[986]: time="2026-09-04T07:39:20.805Z" level=info msg="starting to count repositories" pid=986 storage_path=/var/gitlab/state/repositories1004gitlab # [ 22.381963] gitaly[986]: time="2026-09-04T07:39:20.805Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=986 storage_path=/var/gitlab/state/repositories1005gitlab # [ 22.389351] gitaly[986]: time="2026-09-04T07:39:20.805Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9861006gitlab # [ 22.396760] gitaly[986]: time="2026-09-04T07:39:20.800Z" level=info msg="finished tempdir cleaner walk" pid=986 storage=default time_ms=01007gitlab # [ 22.399820] gitaly[986]: time="2026-09-04T07:39:20.809Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9861008gitlab # [ 22.406901] gitaly[986]: time="2026-09-04T07:39:20.809Z" level=info msg="Started Gitaly" duration_ms=678 pid=9861009gitlab # [ 22.411763] gitaly[986]: time="2026-09-04T07:39:20.809Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9861010gitlab # [ 22.413543] gitaly[986]: time="2026-09-04T07:39:20.810Z" level=info msg="maintenance: daily scheduled" pid=986 scheduled="2026-09-04 12:00:00 +0000 UTC"1011gitlab # [ 26.896605] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[993]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1012gitlab # [ 26.914833] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[993]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1013gitlab # [ 27.032178] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[993]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1014gitlab # [ 30.007027] gitaly[986]: time="2026-09-04T07:39:28.464Z" level=info msg="License database preloaded" duration_ms=8329 pid=9861015gitlab # [ 104.148643] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[993]: W, [2026-09-04T07:40:42.606859 #993] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1016gitlab # [ 106.675299] gitlab-workhorse[871]: time="2026-09-04T07:40:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1017gitlab # [ 107.965011] postgres[1813]: [1813] ERROR: relation "feature_gates" does not exist at character 5231018gitlab # [ 107.965733] postgres[1813]: [1813] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1019gitlab # [ 107.966020] postgres[1813]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1020gitlab # [ 107.966298] postgres[1813]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1021gitlab # [ 107.966498] postgres[1813]: attidentity AS identity,1022gitlab # [ 107.966692] postgres[1813]: attgenerated as attgenerated1023gitlab # [ 107.966938] postgres[1813]: FROM pg_attribute a1024gitlab # [ 107.967163] postgres[1813]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1025gitlab # [ 107.967310] postgres[1813]: LEFT JOIN pg_type t ON a.atttypid = t.oid1026gitlab # [ 107.967550] postgres[1813]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1027gitlab # [ 107.967789] postgres[1813]: WHERE a.attrelid = '"feature_gates"'::regclass1028gitlab # [ 108.001897] postgres[1813]: AND a.attnum > 0 AND NOT a.attisdropped1029gitlab # [ 108.002210] postgres[1813]: ORDER BY a.attnum1030gitlab # [ 108.002526] postgres[1813]:1031gitlab # [ 116.129885] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1882]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1032gitlab # [ 116.133081] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1882]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1033gitlab # [ 116.678975] gitlab-workhorse[871]: time="2026-09-04T07:40:55Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1034gitlab # [ 126.689162] gitlab-workhorse[871]: time="2026-09-04T07:41:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 136.693919] gitlab-workhorse[871]: time="2026-09-04T07:41:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1036gitlab # [ 146.696269] gitlab-workhorse[871]: time="2026-09-04T07:41:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1037gitlab # [ 148.191841] postgres[2057]: [2057] ERROR: relation "table_without_models" does not exist1038gitlab # [ 148.192362] postgres[2057]: [2057] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1039gitlab # [ 156.699528] gitlab-workhorse[871]: time="2026-09-04T07:41:35Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 166.711369] gitlab-workhorse[871]: time="2026-09-04T07:41:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 171.080426] systemd[1]: Finished gitlab-db-config.service.1042gitlab # [ 171.088945] systemd[1]: Started gitlab-sidekiq.service.1043gitlab # [ 171.096768] systemd[1]: Starting gitlab.service...1044gitlab # [ 171.936341] bundle[2342]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1045gitlab # [ 171.937067] bundle[2342]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1046gitlab # [ 171.940133] bundle[2342]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1047gitlab # [ 176.730294] gitlab-workhorse[871]: time="2026-09-04T07:41:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048gitlab # [ 178.650091] sidekiq-cluster[2341]: {"severity":"INFO","time":"2026-09-04T07:41:57.065Z","message":"Starting cluster with 1 processes"}1049gitlab # [ 178.735505] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.159Z","pid":2342,"message":"* Enabling systemd notification integration"}1050gitlab # [ 178.740532] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"Puma starting in cluster mode..."}1051gitlab # [ 178.744891] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1052gitlab # [ 178.749589] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1053gitlab # [ 178.755325] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Min threads: 0"}1054gitlab # [ 178.759431] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Max threads: 4"}1055gitlab # [ 178.764323] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Environment: production"}1056gitlab # [ 178.768369] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Master PID: 2342"}1057gitlab # [ 178.772252] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Workers: 2"}1058gitlab # [ 178.776168] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1059gitlab # [ 178.781779] bundle[2342]: {"timestamp":"2026-09-04T07:41:57.194Z","pid":2342,"message":"* Preloading application"}1060gitlab # [ 186.738346] gitlab-workhorse[871]: time="2026-09-04T07:42:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061gitlab # [ 196.746487] gitlab-workhorse[871]: time="2026-09-04T07:42:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1062gitlab # [ 206.756450] gitlab-workhorse[871]: time="2026-09-04T07:42:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1063gitlab # [ 216.767751] gitlab-workhorse[871]: time="2026-09-04T07:42:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 226.769090] gitlab-workhorse[871]: time="2026-09-04T07:42:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 226.913256] bundle[2342]: W, [2026-09-04T07:42:45.368566 #2342] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1066gitlab # [ 231.465243] sidekiq-cluster[2408]: 2026-09-04T07:42:49.924Z pid=2408 tid=xxc INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2408, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>429748224}1067gitlab # [ 231.846358] sidekiq-cluster[2408]: W, [2026-09-04T07:42:50.306082 #2408] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 231.921635] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:50.381Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1069gitlab # [ 236.135867] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.594Z","message":"GitLab reliable fetch activated!"}1070gitlab # [ 236.136343] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.594Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1071gitlab # [ 236.185542] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.645Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1072gitlab # [ 236.192661] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.650Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1073gitlab # [ 236.199698] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.657Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1074gitlab # [ 236.206378] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.663Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1075gitlab # [ 236.213756] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.670Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1076gitlab # [ 236.219619] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.676Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1077gitlab # [ 236.225339] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.682Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1078gitlab # [ 236.229964] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.687Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1079gitlab # [ 236.234306] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.692Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1080gitlab # [ 236.238434] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.697Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1081gitlab # [ 236.242852] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.702Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1082gitlab # [ 236.248172] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.707Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1083gitlab # [ 236.252462] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.712Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1084gitlab # [ 236.256135] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.715Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1085gitlab # [ 236.261909] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.719Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1086gitlab # [ 236.267112] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.723Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1087gitlab # [ 236.272237] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.728Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1088gitlab # [ 236.276559] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.733Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1089gitlab # [ 236.281041] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.737Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1090gitlab # [ 236.285062] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.741Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1091gitlab # [ 236.289276] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.745Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1092gitlab # [ 236.293408] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.749Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1093gitlab # [ 236.296834] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.753Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1094gitlab # [ 236.300173] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.756Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1095gitlab # [ 236.303417] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.760Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1096gitlab # [ 236.306574] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.764Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1097gitlab # [ 236.309476] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.768Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1098gitlab # [ 236.312313] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.772Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1099gitlab # [ 236.315845] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.775Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1100gitlab # [ 236.320395] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.780Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1101gitlab # [ 236.323153] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.783Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1102gitlab # [ 236.327206] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.786Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1103gitlab # [ 236.330831] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.789Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1104gitlab # [ 236.335493] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.792Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1105gitlab # [ 236.339136] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.794Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1106gitlab # [ 236.342767] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.797Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1107gitlab # [ 236.346306] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.799Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1108gitlab # [ 236.349522] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.802Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1109gitlab # [ 236.352547] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.805Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1110gitlab # [ 236.355375] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.807Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1111gitlab # [ 236.358519] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.809Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1112gitlab # [ 236.361430] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.811Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1113gitlab # [ 236.364201] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.813Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1114gitlab # [ 236.366763] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.815Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1115gitlab # [ 236.369534] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.817Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1116gitlab # [ 236.372233] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.820Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1117gitlab # [ 236.374715] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.822Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1118gitlab # [ 236.377255] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.824Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1119gitlab # [ 236.379550] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.827Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1120gitlab # [ 236.382042] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.829Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1121gitlab # [ 236.384340] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.831Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1122gitlab # [ 236.386520] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.834Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1123gitlab # [ 236.388836] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.846Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1124gitlab # [ 236.391242] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.849Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1125gitlab # [ 236.393567] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.852Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1126gitlab # [ 236.395750] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.854Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1127gitlab # [ 236.398080] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.857Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1128gitlab # [ 236.400365] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.859Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1129gitlab # [ 236.402562] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.861Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1130gitlab # [ 236.404845] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.863Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1131gitlab # [ 236.406859] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.866Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1132gitlab # [ 236.408954] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.868Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1133gitlab # [ 236.411062] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.870Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1134gitlab # [ 236.413601] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.873Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1135gitlab # [ 236.415933] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.875Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1136gitlab # [ 236.418421] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.878Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1137gitlab # [ 236.420862] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.880Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1138gitlab # [ 236.423014] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.882Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1139gitlab # [ 236.425382] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.884Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1140gitlab # [ 236.427654] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.886Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1141gitlab # [ 236.430114] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.888Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1142gitlab # [ 236.432321] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.890Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1143gitlab # [ 236.434524] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.892Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1144gitlab # [ 236.436909] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.894Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1145gitlab # [ 236.439208] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.895Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1146gitlab # [ 236.441648] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.897Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1147gitlab # [ 236.443809] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.899Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1148gitlab # [ 236.446413] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.902Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1149gitlab # [ 236.448625] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.904Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1150gitlab # [ 236.450719] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.906Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1151gitlab # [ 236.453117] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.908Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1152gitlab # [ 236.455484] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.909Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1153gitlab # [ 236.457887] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.912Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1154gitlab # [ 236.460070] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.914Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1155gitlab # [ 236.462483] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.916Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1156gitlab # [ 236.464720] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.918Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1157gitlab # [ 236.467007] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.920Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1158gitlab # [ 236.469329] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.922Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1159gitlab # [ 236.471623] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.924Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1160gitlab # [ 236.474039] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.926Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1161gitlab # [ 236.476289] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.927Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1162gitlab # [ 236.478481] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.929Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1163gitlab # [ 236.480828] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.931Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1164gitlab # [ 236.483220] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.933Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1165gitlab # [ 236.485303] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.935Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1166gitlab # [ 236.487634] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.938Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1167gitlab # [ 236.490059] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.940Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1168gitlab # [ 236.492311] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.942Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1169gitlab # [ 236.494499] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.948Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1170gitlab # [ 236.496776] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.950Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1171gitlab # [ 236.498917] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.952Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1172gitlab # [ 236.501257] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.955Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1173gitlab # [ 236.503289] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.958Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1174gitlab # [ 236.505581] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.961Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1175gitlab # [ 236.507908] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.964Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1176gitlab # [ 236.510437] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.966Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1177gitlab # [ 236.512592] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.968Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1178gitlab # [ 236.514784] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.972Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1179gitlab # [ 236.517044] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:42:54.974Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1180gitlab # [ 236.786544] gitlab-workhorse[871]: time="2026-09-04T07:42:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1181gitlab # [ 246.793710] gitlab-workhorse[871]: time="2026-09-04T07:43:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1182gitlab # [ 256.802433] gitlab-workhorse[871]: time="2026-09-04T07:43:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1183gitlab # [ 266.810726] gitlab-workhorse[871]: time="2026-09-04T07:43:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 276.813291] gitlab-workhorse[871]: time="2026-09-04T07:43:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 280.011619] postgres[3254]: [3254] ERROR: relation "table_without_models" does not exist1186gitlab # [ 280.012272] postgres[3254]: [3254] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1187gitlab # [ 286.047051] postgres[3293]: [3293] ERROR: relation "table_without_models" does not exist1188gitlab # [ 286.051056] postgres[3293]: [3293] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 286.816741] gitlab-workhorse[871]: time="2026-09-04T07:43:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1190gitlab # [ 286.985658] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:45.444Z","message":"Booted Rails 7.2.3.1 application in production environment"}1191gitlab # [ 286.988793] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:45.448Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1192gitlab # [ 286.995290] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:45.448Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1193gitlab # [ 287.001069] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:45.448Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1194gitlab # [ 287.008670] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:45.450Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1195gitlab # [ 289.911835] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:48.370Z","message":"Cleaning working queues"}1196gitlab # [ 289.914049] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:48.373Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f30626b950050775c64a26c7","created_at":"2026-09-04T07:41:48.706Z","trace_propagation_headers":{"sentry-trace":"61e7fc9ddace44b8a8fa968611368b53-2439bfbdd4e847d2","baggage":"sentry-trace_id=61e7fc9ddace44b8a8fa968611368b53,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"3571ad8e46d8773841d62542e4100ed7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:48.722Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f30626b950050775c64a26c7: start","job_status":"start","queue_duration_s":119.649992,"scheduling_latency_s":119.650097}1197gitlab # [ 290.242401] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:43:48.701Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f30626b950050775c64a26c7","created_at":"2026-09-04T07:41:48.706Z","trace_propagation_headers":{"sentry-trace":"61e7fc9ddace44b8a8fa968611368b53-2439bfbdd4e847d2","baggage":"sentry-trace_id=61e7fc9ddace44b8a8fa968611368b53,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"3571ad8e46d8773841d62542e4100ed7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:41:48.722Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f30626b950050775c64a26c7: done: 0.328881 sec","job_status":"done","queue_duration_s":119.649992,"scheduling_latency_s":119.650097,"redis_calls":29,"redis_duration_s":0.011905,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007136,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003046,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.166339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16501686,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.328881,"completed_at":"2026-09-04T07:43:48.701Z","load_balancing_strategy":"primary","db_duration_s":0.082871,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1198gitlab # [ 294.132557] bundle[2342]: {"timestamp":"2026-09-04T07:43:52.591Z","pid":2342,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1199gitlab # [ 294.132927] bundle[2342]: {"timestamp":"2026-09-04T07:43:52.591Z","pid":2342,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1200gitlab # [ 294.133124] bundle[2342]: {"timestamp":"2026-09-04T07:43:52.591Z","pid":2342,"message":"! #\u003cThread:0x0000e28af2b6e940 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1201gitlab # [ 294.133255] bundle[2342]: {"timestamp":"2026-09-04T07:43:52.591Z","pid":2342,"message":"! #\u003cThread:0x0000e28af2d5c090 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1202gitlab # [ 294.133432] bundle[2342]: {"timestamp":"2026-09-04T07:43:52.591Z","pid":2342,"message":"Use Ctrl-C to stop"}1203gitlab # [ 294.133535] bundle[2342]: {"timestamp":"2026-09-04T07:43:52.592Z","pid":2342,"message":"Sending status to systemd every 1.0 sec"}1204gitlab # [ 297.644539] bundle[2342]: {"timestamp":"2026-09-04T07:43:56.102Z","pid":2342,"message":"- Worker 0 (PID: 3438) booted in 3.47s, phase: 0"}1205gitlab # [ 297.685662] bundle[2342]: {"timestamp":"2026-09-04T07:43:56.145Z","pid":2342,"message":"- Worker 1 (PID: 3442) booted in 3.49s, phase: 0"}1206gitlab # [ 297.691216] systemd[1]: Started gitlab.service.1207gitlab # [ 297.692278] systemd[1]: Reached target Common target for all GitLab services..1208gitlab # [ 297.698698] systemd[1]: Starting setup-gitlab.service...1209gitlab # [ 297.748799] setup-gitlab-start[3496]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1210gitlab # [ 298.848860] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:43:57 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 10481211gitlab # [ 298.852578] setup-gitlab-start[3496]: + TOKEN=nixbot-test-token-of-20-chars1212gitlab # [ 298.854540] setup-gitlab-start[3496]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1213gitlab # [ 298.875262] runuser[3511]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1214gitlab # [ 299.485730] setup-gitlab-start[3516]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1215gitlab # [ 299.492367] setup-gitlab-start[3516]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1216gitlab # [ 299.498570] setup-gitlab-start[3516]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1217gitlab # [ 300.420410] setup-gitlab-start[3516]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1218gitlab # [ 300.420812] setup-gitlab-start[3516]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1219gitlab # [ 300.423769] setup-gitlab-start[3516]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1220gitlab # [ 301.843425] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:00.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"cedaf9aec0c7431a47fc0852","created_at":"2026-09-04T07:44:00.206Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fc6a1482d88c488bbe82d2ef1eff9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.295Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-cedaf9aec0c7431a47fc0852: start","job_status":"start","queue_duration_s":0.005412,"scheduling_latency_s":0.005481}1221gitlab # [ 302.068870] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:00.528Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1222gitlab # [ 302.143989] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:00.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"cedaf9aec0c7431a47fc0852","created_at":"2026-09-04T07:44:00.206Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fc6a1482d88c488bbe82d2ef1eff9bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.295Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-cedaf9aec0c7431a47fc0852: done: 0.301183 sec","job_status":"done","queue_duration_s":0.005412,"scheduling_latency_s":0.005481,"redis_calls":10,"redis_duration_s":0.022794000000000002,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003151,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013191,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006452,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00557072,"duration_s":0.301183,"completed_at":"2026-09-04T07:44:00.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060256,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1223gitlab # [ 302.225045] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:00.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5472628675d92fb111ce442c","created_at":"2026-09-04T07:44:00.355Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f51a8027fe27d9e47401d68e2e82028e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.375Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5472628675d92fb111ce442c: start","job_status":"start","queue_duration_s":0.232235,"scheduling_latency_s":0.232303}1224gitlab # [ 302.274065] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:00.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5472628675d92fb111ce442c","created_at":"2026-09-04T07:44:00.355Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f51a8027fe27d9e47401d68e2e82028e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.375Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5472628675d92fb111ce442c: done: 0.124885 sec","job_status":"done","queue_duration_s":0.232235,"scheduling_latency_s":0.232303,"redis_calls":12,"redis_duration_s":0.023060999999999998,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005715,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010902,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0033307,"duration_s":0.124885,"completed_at":"2026-09-04T07:44:00.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016899,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 302.355285] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:00.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"21242cbf52a8f1000190f065","created_at":"2026-09-04T07:44:00.384Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26402e35e52fc78862de19f6ce70fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:44:00.411Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-21242cbf52a8f1000190f065: start","job_status":"start","queue_duration_s":0.333045,"scheduling_latency_s":0.333118}1226gitlab # [ 302.681005] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"21242cbf52a8f1000190f065","created_at":"2026-09-04T07:44:00.384Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26402e35e52fc78862de19f6ce70fbe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:44:00.411Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-21242cbf52a8f1000190f065: done: 0.395519 sec","job_status":"done","queue_duration_s":0.333045,"scheduling_latency_s":0.333118,"redis_calls":10,"redis_duration_s":0.082077,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006473,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.023183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.052421,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00763104,"duration_s":0.395519,"completed_at":"2026-09-04T07:44:01.139Z","load_balancing_strategy":"primary","db_duration_s":0.153493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 302.729028] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3a10823aabda64002efc6026","created_at":"2026-09-04T07:44:00.439Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1315aaddc787348d0c590d0a91f5307","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:44:00.454Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3a10823aabda64002efc6026: start","job_status":"start","queue_duration_s":0.73398,"scheduling_latency_s":0.734023}1228gitlab # [ 302.787811] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.247Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1229gitlab # [ 302.827236] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3a10823aabda64002efc6026","created_at":"2026-09-04T07:44:00.439Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1315aaddc787348d0c590d0a91f5307","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:44:00.454Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3a10823aabda64002efc6026: done: 0.097694 sec","job_status":"done","queue_duration_s":0.73398,"scheduling_latency_s":0.734023,"redis_calls":10,"redis_duration_s":0.034197,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.025448,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006459,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00390438,"duration_s":0.097694,"completed_at":"2026-09-04T07:44:01.286Z","load_balancing_strategy":"primary","db_duration_s":0.001156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 302.921268] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e92b48bcfa0bce0299882e9e","created_at":"2026-09-04T07:44:00.486Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"822e657df12f39e2214ed057c95e8384","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.510Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e92b48bcfa0bce0299882e9e: start","job_status":"start","queue_duration_s":0.785808,"scheduling_latency_s":0.785879}1231gitlab # [ 302.942772] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.351Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1232gitlab # [ 302.947623] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"e92b48bcfa0bce0299882e9e","created_at":"2026-09-04T07:44:00.486Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"822e657df12f39e2214ed057c95e8384","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.510Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-e92b48bcfa0bce0299882e9e: done: 0.094262 sec","job_status":"done","queue_duration_s":0.785808,"scheduling_latency_s":0.785879,"redis_calls":10,"redis_duration_s":0.021829,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00283044,"duration_s":0.094262,"completed_at":"2026-09-04T07:44:01.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00574,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 302.993316] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.410Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"00ee5b8e3c2c6ae44e257f55","created_at":"2026-09-04T07:44:00.549Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.593Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-00ee5b8e3c2c6ae44e257f55: start","job_status":"start","queue_duration_s":0.816239,"scheduling_latency_s":0.81631}1234gitlab # [ 303.214351] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"00ee5b8e3c2c6ae44e257f55","created_at":"2026-09-04T07:44:00.549Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.593Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-00ee5b8e3c2c6ae44e257f55: done: 0.262693 sec","job_status":"done","queue_duration_s":0.816239,"scheduling_latency_s":0.81631,"redis_calls":19,"redis_duration_s":0.119812,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.069172,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001282,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.041229,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.008129,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02131912,"duration_s":0.262693,"completed_at":"2026-09-04T07:44:01.672Z","load_balancing_strategy":"primary","db_duration_s":0.011006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 303.299861] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cfd7133169d40265321e32c1","created_at":"2026-09-04T07:44:00.624Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce4b9b8c59df47d8b2ffc040c8ad3c33","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.679Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cfd7133169d40265321e32c1: start","job_status":"start","queue_duration_s":1.027367,"scheduling_latency_s":1.027431}1236gitlab # [ 303.379138] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cfd7133169d40265321e32c1","created_at":"2026-09-04T07:44:00.624Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce4b9b8c59df47d8b2ffc040c8ad3c33","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.679Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cfd7133169d40265321e32c1: done: 0.131479 sec","job_status":"done","queue_duration_s":1.027367,"scheduling_latency_s":1.027431,"redis_calls":10,"redis_duration_s":0.004033,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00085,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053402,"duration_s":0.131479,"completed_at":"2026-09-04T07:44:01.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 303.462086] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a3f1a2794a14fff10cf50e5d","created_at":"2026-09-04T07:44:00.707Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b474a7a0963fc77a51d39bc520b60c56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.748Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a3f1a2794a14fff10cf50e5d: start","job_status":"start","queue_duration_s":1.091667,"scheduling_latency_s":1.091704}1238gitlab # [ 303.477788] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a3f1a2794a14fff10cf50e5d","created_at":"2026-09-04T07:44:00.707Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b474a7a0963fc77a51d39bc520b60c56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.748Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a3f1a2794a14fff10cf50e5d: done: 0.04659 sec","job_status":"done","queue_duration_s":1.091667,"scheduling_latency_s":1.091704,"redis_calls":12,"redis_duration_s":0.004078,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000663,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001853,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001562,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00088064,"exclusive_lock_hold_duration_s":0.01344724,"duration_s":0.04659,"completed_at":"2026-09-04T07:44:01.887Z","load_balancing_strategy":"primary","db_duration_s":0.007056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 303.521198] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:01.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dc266b3dde10ffdafe215f64","created_at":"2026-09-04T07:44:00.815Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23bb3bdea9e811ae6e547195dabc4661","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.845Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dc266b3dde10ffdafe215f64: start","job_status":"start","queue_duration_s":1.044344,"scheduling_latency_s":1.044377}1240gitlab # [ 303.792348] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"dc266b3dde10ffdafe215f64","created_at":"2026-09-04T07:44:00.815Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23bb3bdea9e811ae6e547195dabc4661","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.845Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-dc266b3dde10ffdafe215f64: done: 0.361813 sec","job_status":"done","queue_duration_s":1.044344,"scheduling_latency_s":1.044377,"redis_calls":565,"redis_duration_s":0.07297999999999999,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.071388,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.325922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002504,"duration_s":0.361813,"completed_at":"2026-09-04T07:44:02.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 303.843323] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f2b04ac9311034fcc647747a","created_at":"2026-09-04T07:44:00.899Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"352d8fa03e00db55bbbdec926410ab9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.985Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f2b04ac9311034fcc647747a: start","job_status":"start","queue_duration_s":1.270266,"scheduling_latency_s":1.270326}1242gitlab # [ 303.857780] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.289Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1243gitlab # [ 303.860969] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f2b04ac9311034fcc647747a","created_at":"2026-09-04T07:44:00.899Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"352d8fa03e00db55bbbdec926410ab9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:00.985Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f2b04ac9311034fcc647747a: done: 0.054116 sec","job_status":"done","queue_duration_s":1.270266,"scheduling_latency_s":1.270326,"redis_calls":10,"redis_duration_s":0.003314,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000747,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056506,"duration_s":0.054116,"completed_at":"2026-09-04T07:44:02.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 303.903447] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4172141bf0e921288301a1c0","created_at":"2026-09-04T07:44:01.049Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a208f103c7618e935cacd616b60c8b1b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.133Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4172141bf0e921288301a1c0: start","job_status":"start","queue_duration_s":1.179361,"scheduling_latency_s":1.179411}1245gitlab # [ 304.035644] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4172141bf0e921288301a1c0","created_at":"2026-09-04T07:44:01.049Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a208f103c7618e935cacd616b60c8b1b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.133Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4172141bf0e921288301a1c0: done: 0.180146 sec","job_status":"done","queue_duration_s":1.179361,"scheduling_latency_s":1.179411,"redis_calls":10,"redis_duration_s":0.014275,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000778,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003839,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00407724,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.180146,"completed_at":"2026-09-04T07:44:02.492Z","load_balancing_strategy":"primary","db_duration_s":0.092398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 304.127081] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c66d5d8d7b6dd4106ef27ab2","created_at":"2026-09-04T07:44:01.178Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"436b442c26dc644e7163664577becddf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.199Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c66d5d8d7b6dd4106ef27ab2: start","job_status":"start","queue_duration_s":1.309551,"scheduling_latency_s":1.309617}1247gitlab # [ 304.298648] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.757Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"c66d5d8d7b6dd4106ef27ab2","created_at":"2026-09-04T07:44:01.178Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"436b442c26dc644e7163664577becddf","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.199Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-c66d5d8d7b6dd4106ef27ab2: done: 0.24778 sec","job_status":"done","queue_duration_s":1.309551,"scheduling_latency_s":1.309617,"redis_calls":16,"redis_duration_s":0.056214,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.026209,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.02414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005865,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00425692,"duration_s":0.24778,"completed_at":"2026-09-04T07:44:02.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.075491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 304.399531] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.765Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"91ce3da4951a8703163fa221","created_at":"2026-09-04T07:44:01.210Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"526de3a13109063e7248ad2247b38511","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.235Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-91ce3da4951a8703163fa221: start","job_status":"start","queue_duration_s":1.529887,"scheduling_latency_s":1.529952}1249gitlab # [ 304.541645] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:02.999Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"91ce3da4951a8703163fa221","created_at":"2026-09-04T07:44:01.210Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"526de3a13109063e7248ad2247b38511","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.235Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-91ce3da4951a8703163fa221: done: 0.234431 sec","job_status":"done","queue_duration_s":1.529887,"scheduling_latency_s":1.529952,"redis_calls":12,"redis_duration_s":0.015575,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000662,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007361,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007552,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00120644,"exclusive_lock_hold_duration_s":0.14756404,"duration_s":0.234431,"completed_at":"2026-09-04T07:44:02.999Z","load_balancing_strategy":"primary","db_duration_s":0.047318,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250gitlab # [ 304.636545] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:03.095Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cf29114d44480f14feeb6f63","created_at":"2026-09-04T07:44:01.267Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7060bb6eebc4c2ec05c679288b0e106d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.292Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cf29114d44480f14feeb6f63: start","job_status":"start","queue_duration_s":1.802648,"scheduling_latency_s":1.802724}1251gitlab # [ 305.150147] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:03.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cf29114d44480f14feeb6f63","created_at":"2026-09-04T07:44:01.267Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7060bb6eebc4c2ec05c679288b0e106d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.292Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cf29114d44480f14feeb6f63: done: 0.511802 sec","job_status":"done","queue_duration_s":1.802648,"scheduling_latency_s":1.802724,"redis_calls":12,"redis_duration_s":0.028773999999999997,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002766,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010152,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.149626,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00493172,"exclusive_lock_hold_duration_s":0.32609768,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.511802,"completed_at":"2026-09-04T07:44:03.607Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 305.257458] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:03.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2e81af55ef8c740d91e2f80e","created_at":"2026-09-04T07:44:01.320Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba7e91a0de702adb31f946ffe41cff5b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.365Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2e81af55ef8c740d91e2f80e: start","job_status":"start","queue_duration_s":2.250372,"scheduling_latency_s":2.250433}1253gitlab # [ 305.281490] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:03.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"2e81af55ef8c740d91e2f80e","created_at":"2026-09-04T07:44:01.320Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba7e91a0de702adb31f946ffe41cff5b","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.365Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-2e81af55ef8c740d91e2f80e: done: 0.124285 sec","job_status":"done","queue_duration_s":2.250372,"scheduling_latency_s":2.250433,"redis_calls":13,"redis_duration_s":0.011526,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001012,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002363,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008151,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02631334,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.124285,"completed_at":"2026-09-04T07:44:03.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021024,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1254gitlab # [ 305.340031] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:03.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"733c3df889f1873aa1421bbe","created_at":"2026-09-04T07:44:01.403Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.442Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-733c3df889f1873aa1421bbe: start","job_status":"start","queue_duration_s":2.305848,"scheduling_latency_s":2.305902}1255gitlab # [ 306.076319] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:04.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"733c3df889f1873aa1421bbe","created_at":"2026-09-04T07:44:01.403Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.442Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-733c3df889f1873aa1421bbe: done: 0.786944 sec","job_status":"done","queue_duration_s":2.305848,"scheduling_latency_s":2.305902,"redis_calls":71,"redis_duration_s":0.200456,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.01748,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.004626,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.17595,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.0024,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.341636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00458424,"duration_s":0.786944,"completed_at":"2026-09-04T07:44:04.534Z","load_balancing_strategy":"primary","db_duration_s":0.025895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 306.098742] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:04.554Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"09907bf55d45505bf00e5cf5","created_at":"2026-09-04T07:44:01.491Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab6217eca2621b4ecdd83eaf35783df2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.522Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-09907bf55d45505bf00e5cf5: start","job_status":"start","queue_duration_s":3.031637,"scheduling_latency_s":3.031705}1257gitlab # [ 306.180663] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:04.619Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"09907bf55d45505bf00e5cf5","created_at":"2026-09-04T07:44:01.491Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab6217eca2621b4ecdd83eaf35783df2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.522Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-09907bf55d45505bf00e5cf5: done: 0.065187 sec","job_status":"done","queue_duration_s":3.031637,"scheduling_latency_s":3.031705,"redis_calls":10,"redis_duration_s":0.004772,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002746,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078546,"duration_s":0.065187,"completed_at":"2026-09-04T07:44:04.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 306.230176] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:04.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d00373b8bdb7a17088b23fb5","created_at":"2026-09-04T07:44:01.565Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d226e933934d66531ddca2c69568668","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.610Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d00373b8bdb7a17088b23fb5: start","job_status":"start","queue_duration_s":3.021412,"scheduling_latency_s":3.021475}1259gitlab # [ 307.390119] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:05.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d00373b8bdb7a17088b23fb5","created_at":"2026-09-04T07:44:01.565Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d226e933934d66531ddca2c69568668","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.610Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d00373b8bdb7a17088b23fb5: done: 1.215799 sec","job_status":"done","queue_duration_s":3.021412,"scheduling_latency_s":3.021475,"redis_calls":14,"redis_duration_s":0.02845,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007625,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009047,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.239,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.239,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.603387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00334508,"exclusive_lock_hold_duration_s":1.01536078,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":1.215799,"completed_at":"2026-09-04T07:44:05.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.562358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 307.416219] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:05.868Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"13757a23a67a93ac02b7be98","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-13757a23a67a93ac02b7be98: start","job_status":"start","queue_duration_s":4.252148,"scheduling_latency_s":4.252217}1261gitlab # [ 307.580973] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.040Z","message":"No existing merge request to be cleaned up."}1262gitlab # [ 307.634899] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.093Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"13757a23a67a93ac02b7be98","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-13757a23a67a93ac02b7be98: done: 0.225253 sec","job_status":"done","queue_duration_s":4.252148,"scheduling_latency_s":4.252217,"redis_calls":13,"redis_duration_s":0.012521000000000001,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003593,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00594,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069998,"duration_s":0.225253,"completed_at":"2026-09-04T07:44:06.093Z","load_balancing_strategy":"primary","db_duration_s":0.034725,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 307.708252] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.101Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ac970762dd168d2ffa4e20af","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ac970762dd168d2ffa4e20af: start","job_status":"start","queue_duration_s":4.484913,"scheduling_latency_s":4.484976}1264gitlab # [ 307.770524] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.230Z","message":"No existing merge request to be cleaned up."}1265gitlab # [ 307.844074] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.302Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ac970762dd168d2ffa4e20af","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ac970762dd168d2ffa4e20af: done: 0.200998 sec","job_status":"done","queue_duration_s":4.484913,"scheduling_latency_s":4.484976,"redis_calls":10,"redis_duration_s":0.023996,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.015043,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.027,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.200998,"completed_at":"2026-09-04T07:44:06.301Z","load_balancing_strategy":"primary","db_duration_s":0.116484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 307.928887] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.308Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ae5830b7a2d47c708a24bfc2","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ae5830b7a2d47c708a24bfc2: start","job_status":"start","queue_duration_s":4.692287,"scheduling_latency_s":4.692353}1267gitlab # [ 307.944637] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.400Z","message":"No existing merge request to be cleaned up."}1268gitlab # [ 308.008666] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.466Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ae5830b7a2d47c708a24bfc2","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ae5830b7a2d47c708a24bfc2: done: 0.158272 sec","job_status":"done","queue_duration_s":4.692287,"scheduling_latency_s":4.692353,"redis_calls":10,"redis_duration_s":0.012161,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005643,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.029,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.029,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047724,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.158272,"completed_at":"2026-09-04T07:44:06.466Z","load_balancing_strategy":"primary","db_duration_s":0.056185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269gitlab # [ 308.087270] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.485Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f0d1ba737f0777b4db82ad60","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f0d1ba737f0777b4db82ad60: start","job_status":"start","queue_duration_s":4.869255,"scheduling_latency_s":4.869322}1270gitlab # [ 308.106164] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.559Z","message":"No existing merge request to be cleaned up."}1271gitlab # [ 308.272722] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.731Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f0d1ba737f0777b4db82ad60","created_at":"2026-09-04T07:44:01.502Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-5165b9e72c2c4119","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9df58cd38691f4706377b2e4a683373a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.616Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f0d1ba737f0777b4db82ad60: done: 0.2457 sec","job_status":"done","queue_duration_s":4.869255,"scheduling_latency_s":4.869322,"redis_calls":10,"redis_duration_s":0.013305,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.006597,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.2457,"completed_at":"2026-09-04T07:44:06.730Z","load_balancing_strategy":"primary","db_duration_s":0.035354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 308.373328] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:06.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"91f547c07c44cea11c95eb21","created_at":"2026-09-04T07:44:01.649Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"747442a295b4fc148eaf65e445c721be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:44:01.680Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-91f547c07c44cea11c95eb21: start","job_status":"start","queue_duration_s":5.152197,"scheduling_latency_s":5.15224}1273gitlab # [ 308.591355] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:07.049Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1274gitlab # [ 308.719654] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:07.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"91f547c07c44cea11c95eb21","created_at":"2026-09-04T07:44:01.649Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"747442a295b4fc148eaf65e445c721be","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:44:01.680Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-91f547c07c44cea11c95eb21: done: 0.345558 sec","job_status":"done","queue_duration_s":5.152197,"scheduling_latency_s":5.15224,"redis_calls":10,"redis_duration_s":0.089467,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004625,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.077044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007798,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0055264,"duration_s":0.345558,"completed_at":"2026-09-04T07:44:07.178Z","load_balancing_strategy":"primary","db_duration_s":0.045567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 308.803379] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:07.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b033dd9fc7b63ca661f3ee37","created_at":"2026-09-04T07:44:01.695Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5910652d288bb8e63e767d09083f9e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.714Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b033dd9fc7b63ca661f3ee37: start","job_status":"start","queue_duration_s":5.488811,"scheduling_latency_s":5.488874}1276gitlab # [ 309.394164] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:07.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"b033dd9fc7b63ca661f3ee37","created_at":"2026-09-04T07:44:01.695Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5910652d288bb8e63e767d09083f9e2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.714Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-b033dd9fc7b63ca661f3ee37: done: 0.64916 sec","job_status":"done","queue_duration_s":5.488811,"scheduling_latency_s":5.488874,"redis_calls":14,"redis_duration_s":0.096983,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.014533,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.024801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.057649,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.081,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.045,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00448114,"exclusive_lock_hold_duration_s":0.12277951999999999,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.64916,"completed_at":"2026-09-04T07:44:07.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.114258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 309.492538] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:07.879Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"f1101d18d47a33283fef857d","created_at":"2026-09-04T07:44:01.736Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f529aee28b7eedbc9aea73d52133b7b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.751Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-f1101d18d47a33283fef857d: start","job_status":"start","queue_duration_s":6.128259,"scheduling_latency_s":6.128379}1278gitlab # [ 309.529378] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:07.989Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1279gitlab # [ 309.571964] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"f1101d18d47a33283fef857d","created_at":"2026-09-04T07:44:01.736Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f529aee28b7eedbc9aea73d52133b7b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.751Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-f1101d18d47a33283fef857d: done: 0.151428 sec","job_status":"done","queue_duration_s":6.128259,"scheduling_latency_s":6.128379,"redis_calls":10,"redis_duration_s":0.037001,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003068,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.023282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.010651,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00156942,"duration_s":0.151428,"completed_at":"2026-09-04T07:44:08.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 309.631799] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b9fe0f38e2ad172bc985270b","created_at":"2026-09-04T07:44:01.758Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"978684276498f769c41335cb0e581176","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.770Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b9fe0f38e2ad172bc985270b: start","job_status":"start","queue_duration_s":6.281431,"scheduling_latency_s":6.281498}1281gitlab # [ 309.724691] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b9fe0f38e2ad172bc985270b","created_at":"2026-09-04T07:44:01.758Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"978684276498f769c41335cb0e581176","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:01.770Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b9fe0f38e2ad172bc985270b: done: 0.131064 sec","job_status":"done","queue_duration_s":6.281431,"scheduling_latency_s":6.281498,"redis_calls":12,"redis_duration_s":0.04109,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007751,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.016176,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00334322,"exclusive_lock_hold_duration_s":0.01250852,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.131064,"completed_at":"2026-09-04T07:44:08.183Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 309.790224] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adce0e1931fa0f95524bb771","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adce0e1931fa0f95524bb771: start","job_status":"start","queue_duration_s":3.716245,"scheduling_latency_s":3.716308}1283gitlab # [ 309.905746] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adce0e1931fa0f95524bb771","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adce0e1931fa0f95524bb771: done: 0.170607 sec","job_status":"done","queue_duration_s":3.716245,"scheduling_latency_s":3.716308,"redis_calls":16,"redis_duration_s":0.037828,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005812,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.015438,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.016578,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00419452,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.170607,"completed_at":"2026-09-04T07:44:08.364Z","load_balancing_strategy":"primary","db_duration_s":0.001345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 309.985838] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aad9190e0489864c6596deee","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aad9190e0489864c6596deee: start","job_status":"start","queue_duration_s":3.904878,"scheduling_latency_s":3.90494}1285gitlab # [ 310.202394] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aad9190e0489864c6596deee","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aad9190e0489864c6596deee: done: 0.278512 sec","job_status":"done","queue_duration_s":3.904878,"scheduling_latency_s":3.90494,"redis_calls":13,"redis_duration_s":0.041657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.01047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.031187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.278512,"completed_at":"2026-09-04T07:44:08.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 310.292463] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a87451800a21d5ef4e9a05bc","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a87451800a21d5ef4e9a05bc: start","job_status":"start","queue_duration_s":4.190636,"scheduling_latency_s":4.190697}1287gitlab # [ 310.342542] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a87451800a21d5ef4e9a05bc","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a87451800a21d5ef4e9a05bc: done: 0.130678 sec","job_status":"done","queue_duration_s":4.190636,"scheduling_latency_s":4.190697,"redis_calls":13,"redis_duration_s":0.046097,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.013324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.032773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.130678,"completed_at":"2026-09-04T07:44:08.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 310.426066] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"504f3452dbb44c3e4097f066","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-504f3452dbb44c3e4097f066: start","job_status":"start","queue_duration_s":4.341473,"scheduling_latency_s":4.341543}1289gitlab # [ 310.495980] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:08.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"504f3452dbb44c3e4097f066","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-504f3452dbb44c3e4097f066: done: 0.133723 sec","job_status":"done","queue_duration_s":4.341473,"scheduling_latency_s":4.341543,"redis_calls":13,"redis_duration_s":0.028795,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.01079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.018005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.133723,"completed_at":"2026-09-04T07:44:08.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 310.582251] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba5eee9254303d29c288e61f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba5eee9254303d29c288e61f: start","job_status":"start","queue_duration_s":4.560417,"scheduling_latency_s":4.560486}1291gitlab # [ 310.736838] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba5eee9254303d29c288e61f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba5eee9254303d29c288e61f: done: 0.156318 sec","job_status":"done","queue_duration_s":4.560417,"scheduling_latency_s":4.560486,"redis_calls":13,"redis_duration_s":0.032628000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.024046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.156318,"completed_at":"2026-09-04T07:44:09.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 310.831865] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd3c0c8a91b78a8a295325de","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd3c0c8a91b78a8a295325de: start","job_status":"start","queue_duration_s":4.812813,"scheduling_latency_s":4.812874}1293gitlab # [ 310.877018] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd3c0c8a91b78a8a295325de","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd3c0c8a91b78a8a295325de: done: 0.044079 sec","job_status":"done","queue_duration_s":4.812813,"scheduling_latency_s":4.812874,"redis_calls":13,"redis_duration_s":0.004521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001611,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00291,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044079,"completed_at":"2026-09-04T07:44:09.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 310.938690] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"028e79fdb998d2e2427a4492","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-028e79fdb998d2e2427a4492: start","job_status":"start","queue_duration_s":4.861308,"scheduling_latency_s":4.861358}1295gitlab # [ 310.955169] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"028e79fdb998d2e2427a4492","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-028e79fdb998d2e2427a4492: done: 0.033763 sec","job_status":"done","queue_duration_s":4.861308,"scheduling_latency_s":4.861358,"redis_calls":13,"redis_duration_s":0.003875,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002458,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033763,"completed_at":"2026-09-04T07:44:09.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 310.999269] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1850a846079ace21e3563e1","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1850a846079ace21e3563e1: start","job_status":"start","queue_duration_s":4.897485,"scheduling_latency_s":4.897521}1297gitlab # [ 311.011616] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1850a846079ace21e3563e1","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1850a846079ace21e3563e1: done: 0.031951 sec","job_status":"done","queue_duration_s":4.897485,"scheduling_latency_s":4.897521,"redis_calls":13,"redis_duration_s":0.004344,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001698,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002646,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031951,"completed_at":"2026-09-04T07:44:09.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 311.049817] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52dd1a7073ac4d018d94ca98","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52dd1a7073ac4d018d94ca98: start","job_status":"start","queue_duration_s":4.932441,"scheduling_latency_s":4.932477}1299gitlab # [ 311.062036] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52dd1a7073ac4d018d94ca98","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52dd1a7073ac4d018d94ca98: done: 0.029802 sec","job_status":"done","queue_duration_s":4.932441,"scheduling_latency_s":4.932477,"redis_calls":13,"redis_duration_s":0.00396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001327,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002633,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029802,"completed_at":"2026-09-04T07:44:09.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 311.100223] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c81ea8da0e9f9d80bd6f2b7","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c81ea8da0e9f9d80bd6f2b7: start","job_status":"start","queue_duration_s":4.964512,"scheduling_latency_s":4.964542}1301gitlab # [ 311.112252] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c81ea8da0e9f9d80bd6f2b7","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c81ea8da0e9f9d80bd6f2b7: done: 0.026368 sec","job_status":"done","queue_duration_s":4.964512,"scheduling_latency_s":4.964542,"redis_calls":13,"redis_duration_s":0.003822,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026368,"completed_at":"2026-09-04T07:44:09.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 311.151831] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73013b681de9d2d92809131d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73013b681de9d2d92809131d: start","job_status":"start","queue_duration_s":4.993329,"scheduling_latency_s":4.993356}1303gitlab # [ 311.164192] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73013b681de9d2d92809131d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73013b681de9d2d92809131d: done: 0.025085 sec","job_status":"done","queue_duration_s":4.993329,"scheduling_latency_s":4.993356,"redis_calls":13,"redis_duration_s":0.003694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001392,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002302,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025085,"completed_at":"2026-09-04T07:44:09.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 311.202512] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6605a1c102a3e121163a1d58","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6605a1c102a3e121163a1d58: start","job_status":"start","queue_duration_s":5.020468,"scheduling_latency_s":5.020494}1305gitlab # [ 311.214543] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6605a1c102a3e121163a1d58","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6605a1c102a3e121163a1d58: done: 0.024126 sec","job_status":"done","queue_duration_s":5.020468,"scheduling_latency_s":5.020494,"redis_calls":13,"redis_duration_s":0.0035269999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001318,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002209,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024126,"completed_at":"2026-09-04T07:44:09.522Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 311.253098] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb11a4184de0cfea86170859","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb11a4184de0cfea86170859: start","job_status":"start","queue_duration_s":5.046644,"scheduling_latency_s":5.046669}1307gitlab # [ 311.265204] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb11a4184de0cfea86170859","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb11a4184de0cfea86170859: done: 0.018417 sec","job_status":"done","queue_duration_s":5.046644,"scheduling_latency_s":5.046669,"redis_calls":13,"redis_duration_s":0.002959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018417,"completed_at":"2026-09-04T07:44:09.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 311.303591] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2657a333ad7932d01a002f04","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2657a333ad7932d01a002f04: start","job_status":"start","queue_duration_s":5.066947,"scheduling_latency_s":5.066967}1309gitlab # [ 311.315964] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2657a333ad7932d01a002f04","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2657a333ad7932d01a002f04: done: 0.017105 sec","job_status":"done","queue_duration_s":5.066947,"scheduling_latency_s":5.066967,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001852,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017105,"completed_at":"2026-09-04T07:44:09.561Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 311.355714] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b079014389e79eee00f1449b","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b079014389e79eee00f1449b: start","job_status":"start","queue_duration_s":5.085665,"scheduling_latency_s":5.085685}1311gitlab # [ 311.367976] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b079014389e79eee00f1449b","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b079014389e79eee00f1449b: done: 0.017965 sec","job_status":"done","queue_duration_s":5.085665,"scheduling_latency_s":5.085685,"redis_calls":13,"redis_duration_s":0.002912,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00194,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017965,"completed_at":"2026-09-04T07:44:09.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 311.406093] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c05e1dc14367accde7ccb99d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c05e1dc14367accde7ccb99d: start","job_status":"start","queue_duration_s":5.105231,"scheduling_latency_s":5.105249}1313gitlab # [ 311.418332] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c05e1dc14367accde7ccb99d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c05e1dc14367accde7ccb99d: done: 0.017591 sec","job_status":"done","queue_duration_s":5.105231,"scheduling_latency_s":5.105249,"redis_calls":13,"redis_duration_s":0.002928,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017591,"completed_at":"2026-09-04T07:44:09.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 311.456595] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e277b9428ff455b256a963f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e277b9428ff455b256a963f: start","job_status":"start","queue_duration_s":5.124523,"scheduling_latency_s":5.124542}1315gitlab # [ 311.468654] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e277b9428ff455b256a963f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e277b9428ff455b256a963f: done: 0.017806 sec","job_status":"done","queue_duration_s":5.124523,"scheduling_latency_s":5.124542,"redis_calls":13,"redis_duration_s":0.002748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017806,"completed_at":"2026-09-04T07:44:09.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 311.507022] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6fff76190d02ce0cddba319","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6fff76190d02ce0cddba319: start","job_status":"start","queue_duration_s":5.144674,"scheduling_latency_s":5.144695}1317gitlab # [ 311.519357] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6fff76190d02ce0cddba319","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6fff76190d02ce0cddba319: done: 0.018099 sec","job_status":"done","queue_duration_s":5.144674,"scheduling_latency_s":5.144695,"redis_calls":13,"redis_duration_s":0.0031520000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018099,"completed_at":"2026-09-04T07:44:09.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 311.560463] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88f2a2c5929af7f441e2be0e","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88f2a2c5929af7f441e2be0e: start","job_status":"start","queue_duration_s":5.164505,"scheduling_latency_s":5.164525}1319gitlab # [ 311.572444] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88f2a2c5929af7f441e2be0e","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88f2a2c5929af7f441e2be0e: done: 0.01763 sec","job_status":"done","queue_duration_s":5.164505,"scheduling_latency_s":5.164525,"redis_calls":13,"redis_duration_s":0.002959,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01763,"completed_at":"2026-09-04T07:44:09.659Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 311.611205] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5b7c7a101210bc7f93f4bb1","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5b7c7a101210bc7f93f4bb1: start","job_status":"start","queue_duration_s":5.183836,"scheduling_latency_s":5.183857}1321gitlab # [ 311.624032] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5b7c7a101210bc7f93f4bb1","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5b7c7a101210bc7f93f4bb1: done: 0.017585 sec","job_status":"done","queue_duration_s":5.183836,"scheduling_latency_s":5.183857,"redis_calls":13,"redis_duration_s":0.003046,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017585,"completed_at":"2026-09-04T07:44:09.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 311.664035] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbb5465e3709e1a651cb72f8","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbb5465e3709e1a651cb72f8: start","job_status":"start","queue_duration_s":5.203133,"scheduling_latency_s":5.203153}1323gitlab # [ 311.676442] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbb5465e3709e1a651cb72f8","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbb5465e3709e1a651cb72f8: done: 0.018674 sec","job_status":"done","queue_duration_s":5.203133,"scheduling_latency_s":5.203153,"redis_calls":13,"redis_duration_s":0.00307,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018674,"completed_at":"2026-09-04T07:44:09.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 311.715858] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f151fd94b134e625a4a6ed1","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f151fd94b134e625a4a6ed1: start","job_status":"start","queue_duration_s":5.223492,"scheduling_latency_s":5.22351}1325gitlab # [ 311.728697] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f151fd94b134e625a4a6ed1","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f151fd94b134e625a4a6ed1: done: 0.017144 sec","job_status":"done","queue_duration_s":5.223492,"scheduling_latency_s":5.22351,"redis_calls":13,"redis_duration_s":0.003103,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017144,"completed_at":"2026-09-04T07:44:09.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 311.770742] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ccabeb16da10e52797c92f2","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ccabeb16da10e52797c92f2: start","job_status":"start","queue_duration_s":5.242115,"scheduling_latency_s":5.242132}1327gitlab # [ 311.783399] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ccabeb16da10e52797c92f2","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ccabeb16da10e52797c92f2: done: 0.016039 sec","job_status":"done","queue_duration_s":5.242115,"scheduling_latency_s":5.242132,"redis_calls":13,"redis_duration_s":0.002564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016039,"completed_at":"2026-09-04T07:44:09.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 311.823879] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b1f27f4521688ca20c7380f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b1f27f4521688ca20c7380f: start","job_status":"start","queue_duration_s":5.259568,"scheduling_latency_s":5.259586}1329gitlab # [ 311.836670] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b1f27f4521688ca20c7380f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b1f27f4521688ca20c7380f: done: 0.016445 sec","job_status":"done","queue_duration_s":5.259568,"scheduling_latency_s":5.259586,"redis_calls":13,"redis_duration_s":0.0027099999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001754,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016445,"completed_at":"2026-09-04T07:44:09.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 311.876732] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c858637bbd1f1c5636d151","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c858637bbd1f1c5636d151: start","job_status":"start","queue_duration_s":5.278035,"scheduling_latency_s":5.278054}1331gitlab # [ 311.889471] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c858637bbd1f1c5636d151","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c858637bbd1f1c5636d151: done: 0.017244 sec","job_status":"done","queue_duration_s":5.278035,"scheduling_latency_s":5.278054,"redis_calls":13,"redis_duration_s":0.00332,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017244,"completed_at":"2026-09-04T07:44:09.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 311.929813] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1c8186034a7e47da4733aa4","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1c8186034a7e47da4733aa4: start","job_status":"start","queue_duration_s":5.296828,"scheduling_latency_s":5.296845}1333gitlab # [ 311.942379] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1c8186034a7e47da4733aa4","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1c8186034a7e47da4733aa4: done: 0.017027 sec","job_status":"done","queue_duration_s":5.296828,"scheduling_latency_s":5.296845,"redis_calls":13,"redis_duration_s":0.003026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017027,"completed_at":"2026-09-04T07:44:09.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 311.983108] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76f65f13297aa229d4bb052d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76f65f13297aa229d4bb052d: start","job_status":"start","queue_duration_s":5.315491,"scheduling_latency_s":5.31551}1335gitlab # [ 311.995604] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76f65f13297aa229d4bb052d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76f65f13297aa229d4bb052d: done: 0.01721 sec","job_status":"done","queue_duration_s":5.315491,"scheduling_latency_s":5.31551,"redis_calls":13,"redis_duration_s":0.003007,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01721,"completed_at":"2026-09-04T07:44:09.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 312.035641] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54aee5687de9ac13a89af601","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54aee5687de9ac13a89af601: start","job_status":"start","queue_duration_s":5.334322,"scheduling_latency_s":5.334343}1337gitlab # [ 312.048252] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54aee5687de9ac13a89af601","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54aee5687de9ac13a89af601: done: 0.01769 sec","job_status":"done","queue_duration_s":5.334322,"scheduling_latency_s":5.334343,"redis_calls":13,"redis_duration_s":0.002969,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01769,"completed_at":"2026-09-04T07:44:09.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 312.088564] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a60d2e616b34634ac749b8ab","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a60d2e616b34634ac749b8ab: start","job_status":"start","queue_duration_s":5.353645,"scheduling_latency_s":5.353664}1339gitlab # [ 312.100767] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a60d2e616b34634ac749b8ab","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a60d2e616b34634ac749b8ab: done: 0.017507 sec","job_status":"done","queue_duration_s":5.353645,"scheduling_latency_s":5.353664,"redis_calls":13,"redis_duration_s":0.00295,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017507,"completed_at":"2026-09-04T07:44:09.848Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 312.139685] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70c6a9d166e9a96df1fada6f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70c6a9d166e9a96df1fada6f: start","job_status":"start","queue_duration_s":5.372749,"scheduling_latency_s":5.372767}1341gitlab # [ 312.152138] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70c6a9d166e9a96df1fada6f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70c6a9d166e9a96df1fada6f: done: 0.017998 sec","job_status":"done","queue_duration_s":5.372749,"scheduling_latency_s":5.372767,"redis_calls":13,"redis_duration_s":0.003108,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017998,"completed_at":"2026-09-04T07:44:09.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 312.192686] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d466fd92e6ad35e07ba50fcc","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d466fd92e6ad35e07ba50fcc: start","job_status":"start","queue_duration_s":5.39239,"scheduling_latency_s":5.392407}1343gitlab # [ 312.205168] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d466fd92e6ad35e07ba50fcc","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d466fd92e6ad35e07ba50fcc: done: 0.017092 sec","job_status":"done","queue_duration_s":5.39239,"scheduling_latency_s":5.392407,"redis_calls":13,"redis_duration_s":0.002849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017092,"completed_at":"2026-09-04T07:44:09.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 312.244494] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48eb56a1ca8827df26fc3303","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48eb56a1ca8827df26fc3303: start","job_status":"start","queue_duration_s":5.411085,"scheduling_latency_s":5.411104}1345gitlab # [ 312.256867] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48eb56a1ca8827df26fc3303","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48eb56a1ca8827df26fc3303: done: 0.016503 sec","job_status":"done","queue_duration_s":5.411085,"scheduling_latency_s":5.411104,"redis_calls":13,"redis_duration_s":0.002719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016503,"completed_at":"2026-09-04T07:44:09.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 312.295930] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77f2a741d26696a5d351f2e4","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77f2a741d26696a5d351f2e4: start","job_status":"start","queue_duration_s":5.429084,"scheduling_latency_s":5.429104}1347gitlab # [ 312.308228] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77f2a741d26696a5d351f2e4","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77f2a741d26696a5d351f2e4: done: 0.016901 sec","job_status":"done","queue_duration_s":5.429084,"scheduling_latency_s":5.429104,"redis_calls":13,"redis_duration_s":0.00287,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016901,"completed_at":"2026-09-04T07:44:09.923Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 312.347732] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a294bc8b4f5dd79cbdeac52d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a294bc8b4f5dd79cbdeac52d: start","job_status":"start","queue_duration_s":5.447458,"scheduling_latency_s":5.447476}1349gitlab # [ 312.360255] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a294bc8b4f5dd79cbdeac52d","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a294bc8b4f5dd79cbdeac52d: done: 0.016672 sec","job_status":"done","queue_duration_s":5.447458,"scheduling_latency_s":5.447476,"redis_calls":13,"redis_duration_s":0.0029040000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016672,"completed_at":"2026-09-04T07:44:09.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 312.400780] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb3dfc10173b661c0d111d86","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb3dfc10173b661c0d111d86: start","job_status":"start","queue_duration_s":5.465696,"scheduling_latency_s":5.465715}1351gitlab # [ 312.413051] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb3dfc10173b661c0d111d86","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb3dfc10173b661c0d111d86: done: 0.017094 sec","job_status":"done","queue_duration_s":5.465696,"scheduling_latency_s":5.465715,"redis_calls":13,"redis_duration_s":0.002853,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017094,"completed_at":"2026-09-04T07:44:09.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 312.451767] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"431f1601a9591a1be141b951","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-431f1601a9591a1be141b951: start","job_status":"start","queue_duration_s":5.484362,"scheduling_latency_s":5.484381}1353gitlab # [ 312.464270] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"431f1601a9591a1be141b951","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-431f1601a9591a1be141b951: done: 0.018256 sec","job_status":"done","queue_duration_s":5.484362,"scheduling_latency_s":5.484381,"redis_calls":13,"redis_duration_s":0.003353,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001423,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018256,"completed_at":"2026-09-04T07:44:09.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 312.503125] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b907bd0bf4f5757404737ae7","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b907bd0bf4f5757404737ae7: start","job_status":"start","queue_duration_s":5.50425,"scheduling_latency_s":5.504269}1355gitlab # [ 312.515679] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:09.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b907bd0bf4f5757404737ae7","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b907bd0bf4f5757404737ae7: done: 0.017396 sec","job_status":"done","queue_duration_s":5.50425,"scheduling_latency_s":5.504269,"redis_calls":13,"redis_duration_s":0.0031149999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017396,"completed_at":"2026-09-04T07:44:09.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 312.555025] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc424d2dabff94600c33cbfd","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc424d2dabff94600c33cbfd: start","job_status":"start","queue_duration_s":5.52329,"scheduling_latency_s":5.52331}1357gitlab # [ 312.567530] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc424d2dabff94600c33cbfd","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc424d2dabff94600c33cbfd: done: 0.02822 sec","job_status":"done","queue_duration_s":5.52329,"scheduling_latency_s":5.52331,"redis_calls":13,"redis_duration_s":0.004052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02822,"completed_at":"2026-09-04T07:44:10.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 312.608535] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"875a5a4eb17a2a0024f85fbb","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-875a5a4eb17a2a0024f85fbb: start","job_status":"start","queue_duration_s":5.555747,"scheduling_latency_s":5.5558}1359gitlab # [ 312.620795] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"875a5a4eb17a2a0024f85fbb","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-875a5a4eb17a2a0024f85fbb: done: 0.041975 sec","job_status":"done","queue_duration_s":5.555747,"scheduling_latency_s":5.5558,"redis_calls":13,"redis_duration_s":0.004338,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041975,"completed_at":"2026-09-04T07:44:10.075Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 312.659957] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d55306269ad2f6bbcfde8fea","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d55306269ad2f6bbcfde8fea: start","job_status":"start","queue_duration_s":5.600256,"scheduling_latency_s":5.600296}1361gitlab # [ 312.672640] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d55306269ad2f6bbcfde8fea","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d55306269ad2f6bbcfde8fea: done: 0.033656 sec","job_status":"done","queue_duration_s":5.600256,"scheduling_latency_s":5.600296,"redis_calls":13,"redis_duration_s":0.003111,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033656,"completed_at":"2026-09-04T07:44:10.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 312.711994] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de916efb353ddf2d63734fdc","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de916efb353ddf2d63734fdc: start","job_status":"start","queue_duration_s":5.636836,"scheduling_latency_s":5.636877}1363gitlab # [ 312.724394] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de916efb353ddf2d63734fdc","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de916efb353ddf2d63734fdc: done: 0.031509 sec","job_status":"done","queue_duration_s":5.636836,"scheduling_latency_s":5.636877,"redis_calls":13,"redis_duration_s":0.0033359999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031509,"completed_at":"2026-09-04T07:44:10.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 312.763900] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa87361f279a7541dce1083f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa87361f279a7541dce1083f: start","job_status":"start","queue_duration_s":5.670733,"scheduling_latency_s":5.670773}1365gitlab # [ 312.778256] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa87361f279a7541dce1083f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa87361f279a7541dce1083f: done: 0.022055 sec","job_status":"done","queue_duration_s":5.670733,"scheduling_latency_s":5.670773,"redis_calls":13,"redis_duration_s":0.001889,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022055,"completed_at":"2026-09-04T07:44:10.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 312.818569] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"debbcc3b6658dc33019cb417","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-debbcc3b6658dc33019cb417: start","job_status":"start","queue_duration_s":5.694698,"scheduling_latency_s":5.694726}1367gitlab # [ 312.856056] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"debbcc3b6658dc33019cb417","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-debbcc3b6658dc33019cb417: done: 0.0183 sec","job_status":"done","queue_duration_s":5.694698,"scheduling_latency_s":5.694726,"redis_calls":13,"redis_duration_s":0.0016710000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0183,"completed_at":"2026-09-04T07:44:10.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 312.926919] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa75fe3ec43fa3e329d7199f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa75fe3ec43fa3e329d7199f: start","job_status":"start","queue_duration_s":5.7145,"scheduling_latency_s":5.714526}1369gitlab # [ 312.941340] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa75fe3ec43fa3e329d7199f","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa75fe3ec43fa3e329d7199f: done: 0.017413 sec","job_status":"done","queue_duration_s":5.7145,"scheduling_latency_s":5.714526,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017413,"completed_at":"2026-09-04T07:44:10.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 312.982135] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf63007f1735220ff357fc4","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf63007f1735220ff357fc4: start","job_status":"start","queue_duration_s":5.733372,"scheduling_latency_s":5.733394}1371gitlab # [ 312.994588] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcf63007f1735220ff357fc4","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcf63007f1735220ff357fc4: done: 0.017607 sec","job_status":"done","queue_duration_s":5.733372,"scheduling_latency_s":5.733394,"redis_calls":13,"redis_duration_s":0.0017100000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001075,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017607,"completed_at":"2026-09-04T07:44:10.228Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 313.033503] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f696745d5e9469afc77f44","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f696745d5e9469afc77f44: start","job_status":"start","queue_duration_s":5.752463,"scheduling_latency_s":5.752489}1373gitlab # [ 313.045838] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f696745d5e9469afc77f44","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f696745d5e9469afc77f44: done: 0.017301 sec","job_status":"done","queue_duration_s":5.752463,"scheduling_latency_s":5.752489,"redis_calls":13,"redis_duration_s":0.001745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017301,"completed_at":"2026-09-04T07:44:10.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 313.084613] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8886ee6938c579a3178cc7d2","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8886ee6938c579a3178cc7d2: start","job_status":"start","queue_duration_s":5.77126,"scheduling_latency_s":5.771287}1375gitlab # [ 313.096874] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8886ee6938c579a3178cc7d2","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8886ee6938c579a3178cc7d2: done: 0.017656 sec","job_status":"done","queue_duration_s":5.77126,"scheduling_latency_s":5.771287,"redis_calls":13,"redis_duration_s":0.0018089999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017656,"completed_at":"2026-09-04T07:44:10.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 313.136035] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf053c9b016004aea199e53c","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf053c9b016004aea199e53c: start","job_status":"start","queue_duration_s":5.790534,"scheduling_latency_s":5.790561}1377gitlab # [ 313.148174] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf053c9b016004aea199e53c","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf053c9b016004aea199e53c: done: 0.018853 sec","job_status":"done","queue_duration_s":5.790534,"scheduling_latency_s":5.790561,"redis_calls":13,"redis_duration_s":0.0018549999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018853,"completed_at":"2026-09-04T07:44:10.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 313.188123] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b88ef9a3e077a0c1c53c8e06","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b88ef9a3e077a0c1c53c8e06: start","job_status":"start","queue_duration_s":5.810941,"scheduling_latency_s":5.810966}1379gitlab # [ 313.200358] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b88ef9a3e077a0c1c53c8e06","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b88ef9a3e077a0c1c53c8e06: done: 0.018009 sec","job_status":"done","queue_duration_s":5.810941,"scheduling_latency_s":5.810966,"redis_calls":13,"redis_duration_s":0.001904,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001226,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018009,"completed_at":"2026-09-04T07:44:10.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 313.239258] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6879442f24f7a1ac852568ea","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6879442f24f7a1ac852568ea: start","job_status":"start","queue_duration_s":5.830518,"scheduling_latency_s":5.830544}1381gitlab # [ 313.251708] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6879442f24f7a1ac852568ea","created_at":"2026-09-04T07:44:03.894Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-6fb0c1e9c9ec453e","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c7777a291a6d6ea1b59de1fcc1d880ef","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:04.477Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6879442f24f7a1ac852568ea: done: 0.017058 sec","job_status":"done","queue_duration_s":5.830518,"scheduling_latency_s":5.830544,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017058,"completed_at":"2026-09-04T07:44:10.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 313.290951] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"88f8bd0598aa68972057e121","created_at":"2026-09-04T07:44:06.699Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82b107469137534ddf41b7e60914df45","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.025Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-88f8bd0598aa68972057e121: start","job_status":"start","queue_duration_s":3.300817,"scheduling_latency_s":3.300839}1383gitlab # [ 313.305431] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"88f8bd0598aa68972057e121","created_at":"2026-09-04T07:44:06.699Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82b107469137534ddf41b7e60914df45","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.025Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-88f8bd0598aa68972057e121: done: 0.031262 sec","job_status":"done","queue_duration_s":3.300817,"scheduling_latency_s":3.300839,"redis_calls":12,"redis_duration_s":0.002191,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058044,"exclusive_lock_hold_duration_s":0.00964496,"duration_s":0.031262,"completed_at":"2026-09-04T07:44:10.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 313.347234] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.359Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"eb133315756272127896132b","created_at":"2026-09-04T07:44:07.116Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"51e8f69264bd75e2d3dff27eeecde44b","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.189Z","job_size_bytes":3,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-eb133315756272127896132b: start","job_status":"start","queue_duration_s":3.169979,"scheduling_latency_s":3.170003}1385gitlab # [ 313.361072] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.384Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"eb133315756272127896132b","created_at":"2026-09-04T07:44:07.116Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"51e8f69264bd75e2d3dff27eeecde44b","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.189Z","job_size_bytes":3,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-eb133315756272127896132b: done: 0.025208 sec","job_status":"done","queue_duration_s":3.169979,"scheduling_latency_s":3.170003,"redis_calls":10,"redis_duration_s":0.001879,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000602,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000358,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012638,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026948,"duration_s":0.025208,"completed_at":"2026-09-04T07:44:10.384Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000573,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 313.403052] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.386Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"7694af8fb41008e0e60d7d63","created_at":"2026-09-04T07:44:07.238Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.270Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-7694af8fb41008e0e60d7d63: start","job_status":"start","queue_duration_s":3.115437,"scheduling_latency_s":3.115461}1387gitlab # [ 313.417365] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.446Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"7694af8fb41008e0e60d7d63","created_at":"2026-09-04T07:44:07.238Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.270Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-7694af8fb41008e0e60d7d63: done: 0.060165 sec","job_status":"done","queue_duration_s":3.115437,"scheduling_latency_s":3.115461,"redis_calls":28,"redis_duration_s":0.004865,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000717,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000447,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.002709,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003306,"duration_s":0.060165,"completed_at":"2026-09-04T07:44:10.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 313.460358] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"94245fc94d347373c4cf4179","created_at":"2026-09-04T07:44:07.472Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09a7e61e82195045d93d7d92bbea6882","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.501Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-94245fc94d347373c4cf4179: start","job_status":"start","queue_duration_s":2.946143,"scheduling_latency_s":2.946169}1389gitlab # [ 313.474561] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"94245fc94d347373c4cf4179","created_at":"2026-09-04T07:44:07.472Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09a7e61e82195045d93d7d92bbea6882","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.501Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-94245fc94d347373c4cf4179: done: 0.034918 sec","job_status":"done","queue_duration_s":2.946143,"scheduling_latency_s":2.946169,"redis_calls":10,"redis_duration_s":0.001789,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00037,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002885,"duration_s":0.034918,"completed_at":"2026-09-04T07:44:10.482Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 313.516330] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.484Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a7568a2c960c7e80d00347af","created_at":"2026-09-04T07:44:07.576Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8441e6035c6f6111a5b24c33a134a86","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.634Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a7568a2c960c7e80d00347af: start","job_status":"start","queue_duration_s":2.849621,"scheduling_latency_s":2.849647}1391gitlab # [ 313.529366] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.506Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a7568a2c960c7e80d00347af","created_at":"2026-09-04T07:44:07.576Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8441e6035c6f6111a5b24c33a134a86","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:44:07.634Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a7568a2c960c7e80d00347af: done: 0.021845 sec","job_status":"done","queue_duration_s":2.849621,"scheduling_latency_s":2.849647,"redis_calls":12,"redis_duration_s":0.001773,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000395,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000314,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025126,"duration_s":0.021845,"completed_at":"2026-09-04T07:44:10.506Z","load_balancing_strategy":"primary","db_duration_s":0.000518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 313.570831] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"280b05f7b89a3ff6d6bc9b88","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-280b05f7b89a3ff6d6bc9b88: start","job_status":"start","queue_duration_s":0.071377,"scheduling_latency_s":0.071415}1393gitlab # [ 313.583922] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"280b05f7b89a3ff6d6bc9b88","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-280b05f7b89a3ff6d6bc9b88: done: 0.051382 sec","job_status":"done","queue_duration_s":0.071377,"scheduling_latency_s":0.071415,"redis_calls":16,"redis_duration_s":0.002819,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027374,"duration_s":0.051382,"completed_at":"2026-09-04T07:44:10.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 313.625709] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"422c14b87448118cb5f2cf7b","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-422c14b87448118cb5f2cf7b: start","job_status":"start","queue_duration_s":0.124308,"scheduling_latency_s":0.124334}1395gitlab # [ 313.638952] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"422c14b87448118cb5f2cf7b","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-422c14b87448118cb5f2cf7b: done: 0.02084 sec","job_status":"done","queue_duration_s":0.124308,"scheduling_latency_s":0.124334,"redis_calls":13,"redis_duration_s":0.0025009999999999998,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02084,"completed_at":"2026-09-04T07:44:10.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 313.677672] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bc91f7b05b38b97e92646ada","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bc91f7b05b38b97e92646ada: start","job_status":"start","queue_duration_s":0.146551,"scheduling_latency_s":0.146576}1397gitlab # [ 313.691046] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bc91f7b05b38b97e92646ada","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bc91f7b05b38b97e92646ada: done: 0.022486 sec","job_status":"done","queue_duration_s":0.146551,"scheduling_latency_s":0.146576,"redis_calls":13,"redis_duration_s":0.001832,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022486,"completed_at":"2026-09-04T07:44:10.605Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 313.730134] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"536bd3c63dae57d7221783e9","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-536bd3c63dae57d7221783e9: start","job_status":"start","queue_duration_s":0.170494,"scheduling_latency_s":0.170519}1399gitlab # [ 313.743226] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"536bd3c63dae57d7221783e9","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-536bd3c63dae57d7221783e9: done: 0.023752 sec","job_status":"done","queue_duration_s":0.170494,"scheduling_latency_s":0.170519,"redis_calls":13,"redis_duration_s":0.002515,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023752,"completed_at":"2026-09-04T07:44:10.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 313.782388] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"73f1d0b0c598ec3ec55ecf24","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-73f1d0b0c598ec3ec55ecf24: start","job_status":"start","queue_duration_s":0.195761,"scheduling_latency_s":0.195786}1401gitlab # [ 313.796684] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"73f1d0b0c598ec3ec55ecf24","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-73f1d0b0c598ec3ec55ecf24: done: 0.021635 sec","job_status":"done","queue_duration_s":0.195761,"scheduling_latency_s":0.195786,"redis_calls":13,"redis_duration_s":0.001822,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001165,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013487,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021635,"completed_at":"2026-09-04T07:44:10.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 313.835713] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5c702e3ead08ac1dc7eb46aa","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5c702e3ead08ac1dc7eb46aa: start","job_status":"start","queue_duration_s":0.21915,"scheduling_latency_s":0.219171}1403gitlab # [ 313.848992] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5c702e3ead08ac1dc7eb46aa","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5c702e3ead08ac1dc7eb46aa: done: 0.019673 sec","job_status":"done","queue_duration_s":0.21915,"scheduling_latency_s":0.219171,"redis_calls":13,"redis_duration_s":0.002071,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019673,"completed_at":"2026-09-04T07:44:10.674Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 313.887776] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"36bd9ce599248b59dc350679","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-36bd9ce599248b59dc350679: start","job_status":"start","queue_duration_s":0.240423,"scheduling_latency_s":0.240445}1405gitlab # [ 313.900913] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"36bd9ce599248b59dc350679","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-36bd9ce599248b59dc350679: done: 0.019097 sec","job_status":"done","queue_duration_s":0.240423,"scheduling_latency_s":0.240445,"redis_calls":13,"redis_duration_s":0.0017140000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019097,"completed_at":"2026-09-04T07:44:10.695Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 313.939842] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"11204f2c7b6835fd468c7e15","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-11204f2c7b6835fd468c7e15: start","job_status":"start","queue_duration_s":0.260844,"scheduling_latency_s":0.260863}1407gitlab # [ 313.952968] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"11204f2c7b6835fd468c7e15","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-11204f2c7b6835fd468c7e15: done: 0.017673 sec","job_status":"done","queue_duration_s":0.260844,"scheduling_latency_s":0.260863,"redis_calls":13,"redis_duration_s":0.001738,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017673,"completed_at":"2026-09-04T07:44:10.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 313.991365] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ec46540259ba2ded68d6453d","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ec46540259ba2ded68d6453d: start","job_status":"start","queue_duration_s":0.279805,"scheduling_latency_s":0.279852}1409gitlab # [ 314.005644] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ec46540259ba2ded68d6453d","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ec46540259ba2ded68d6453d: done: 0.018144 sec","job_status":"done","queue_duration_s":0.279805,"scheduling_latency_s":0.279852,"redis_calls":13,"redis_duration_s":0.001838,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018144,"completed_at":"2026-09-04T07:44:10.734Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 314.044519] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2ec88293ffc157fc586f1420","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2ec88293ffc157fc586f1420: start","job_status":"start","queue_duration_s":0.299247,"scheduling_latency_s":0.299267}1411gitlab # [ 314.057509] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:44:10.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2ec88293ffc157fc586f1420","created_at":"2026-09-04T07:44:10.412Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-ac238eb315cd4df3","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"931c87c8589d7179e36e1a21b477136b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:44:10.436Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2ec88293ffc157fc586f1420: done: 0.017952 sec","job_status":"done","queue_duration_s":0.299247,"scheduling_latency_s":0.299267,"redis_calls":13,"redis_duration_s":0.0017989999999999998,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017952,"completed_at":"2026-09-04T07:44:10.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001228,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 314.635403] redis[812]: 10 changes in 300 seconds. Saving...1413gitlab # [ 314.638694] redis[812]: Background saving started by pid 35811414gitlab # [ 314.645283] redis[3581]: BGSAVE done, 435 keys saved, 0 keys skipped, 116059 bytes written.1415gitlab # [ 314.650528] redis[3581]: DB saved on disk1416gitlab # [ 314.652805] redis[3581]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1417gitlab # [ 314.736710] redis[812]: Background saving terminated with success1418gitlab # [ 319.063056] postgres[925]: [925] LOG: checkpoint starting: time1419gitlab # [ 322.231932] gitaly[986]: time="2026-09-04T07:44:20.689Z" level=info msg="burden monitor stats" pid=9861420gitlab # [ 347.961310] setup-gitlab-start[3516]: W, [2026-09-04T07:44:46.419664 #3516] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1421gitlab # [ 364.857502] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:03.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bedff67a4dd32288ec69a9f6","created_at":"2026-09-04T07:45:03.222Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ba3c8bdcd7f6797cfef97c1e6b95d41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.311Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bedff67a4dd32288ec69a9f6: start","job_status":"start","queue_duration_s":0.004046,"scheduling_latency_s":0.004097}1422gitlab # [ 365.018208] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:03.477Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1423gitlab # [ 365.153315] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:03.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bedff67a4dd32288ec69a9f6","created_at":"2026-09-04T07:45:03.222Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ba3c8bdcd7f6797cfef97c1e6b95d41","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.311Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bedff67a4dd32288ec69a9f6: done: 0.29589 sec","job_status":"done","queue_duration_s":0.004046,"scheduling_latency_s":0.004097,"redis_calls":15,"redis_duration_s":0.04094,"redis_read_bytes":1029,"redis_write_bytes":1401,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.020332,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":575,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009878,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.29589,"completed_at":"2026-09-04T07:45:03.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 365.254291] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:03.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9a41ccfc5ba4d059ac902e79","created_at":"2026-09-04T07:45:03.384Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75aa81d0d64b71d8883ab3777d585507","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.392Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9a41ccfc5ba4d059ac902e79: start","job_status":"start","queue_duration_s":0.231773,"scheduling_latency_s":0.231842}1425gitlab # [ 365.347504] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:03.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"9a41ccfc5ba4d059ac902e79","created_at":"2026-09-04T07:45:03.384Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75aa81d0d64b71d8883ab3777d585507","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.392Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-9a41ccfc5ba4d059ac902e79: done: 0.181433 sec","job_status":"done","queue_duration_s":0.231773,"scheduling_latency_s":0.231842,"redis_calls":10,"redis_duration_s":0.026741,"redis_read_bytes":389,"redis_write_bytes":1014,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001713,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":238,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007582,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.017446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.181433,"completed_at":"2026-09-04T07:45:03.805Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 365.413827] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:03.832Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f6d02e32ec72d2066e319e94","created_at":"2026-09-04T07:45:03.408Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9316e52425ca2aab92485b9fb697ddaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:45:03.417Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f6d02e32ec72d2066e319e94: start","job_status":"start","queue_duration_s":0.415097,"scheduling_latency_s":0.415166}1427gitlab # [ 365.513348] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:03.971Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f6d02e32ec72d2066e319e94","created_at":"2026-09-04T07:45:03.408Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9316e52425ca2aab92485b9fb697ddaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:45:03.417Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f6d02e32ec72d2066e319e94: done: 0.139377 sec","job_status":"done","queue_duration_s":0.415097,"scheduling_latency_s":0.415166,"redis_calls":8,"redis_duration_s":0.02271,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.004843,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006951,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.139377,"completed_at":"2026-09-04T07:45:03.971Z","load_balancing_strategy":"primary","db_duration_s":0.010477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 365.603634] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"09837f9798964f4f70879d55","created_at":"2026-09-04T07:45:03.443Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f699a52a268648a367945a3be8ac04e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:45:03.460Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-09837f9798964f4f70879d55: start","job_status":"start","queue_duration_s":0.567681,"scheduling_latency_s":0.567759}1429gitlab # [ 365.651771] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.111Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1430gitlab # [ 365.700427] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"09837f9798964f4f70879d55","created_at":"2026-09-04T07:45:03.443Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f699a52a268648a367945a3be8ac04e0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:45:03.460Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-09837f9798964f4f70879d55: done: 0.127065 sec","job_status":"done","queue_duration_s":0.567681,"scheduling_latency_s":0.567759,"redis_calls":8,"redis_duration_s":0.02596,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.004592,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.018096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127065,"completed_at":"2026-09-04T07:45:04.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 365.782152] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8d0c89cd19fb48a1677dddab","created_at":"2026-09-04T07:45:03.506Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4aa6b5bf03f5aeb2df0eb1b04c2389fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.542Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8d0c89cd19fb48a1677dddab: start","job_status":"start","queue_duration_s":0.629343,"scheduling_latency_s":0.629428}1432gitlab # [ 365.798874] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.253Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1433gitlab # [ 365.833296] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"8d0c89cd19fb48a1677dddab","created_at":"2026-09-04T07:45:03.506Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4aa6b5bf03f5aeb2df0eb1b04c2389fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.542Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-8d0c89cd19fb48a1677dddab: done: 0.120249 sec","job_status":"done","queue_duration_s":0.629343,"scheduling_latency_s":0.629428,"redis_calls":8,"redis_duration_s":0.029786,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.014578,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00849,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.120249,"completed_at":"2026-09-04T07:45:04.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 365.924386] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.349Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"69c38495a97e300e403aea9c","created_at":"2026-09-04T07:45:03.591Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.618Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-69c38495a97e300e403aea9c: start","job_status":"start","queue_duration_s":0.731755,"scheduling_latency_s":0.731818}1435gitlab # [ 366.297126] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"69c38495a97e300e403aea9c","created_at":"2026-09-04T07:45:03.591Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.618Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-69c38495a97e300e403aea9c: done: 0.40511 sec","job_status":"done","queue_duration_s":0.731755,"scheduling_latency_s":0.731818,"redis_calls":18,"redis_duration_s":0.07806099999999999,"redis_read_bytes":404,"redis_write_bytes":4278,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.008043,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":248,"redis_queues_calls":2,"redis_queues_duration_s":0.006421,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.053291,"redis_queues_metadata_read_bytes":16,"redis_queues_metadata_write_bytes":731,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.010306,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.40511,"completed_at":"2026-09-04T07:45:04.754Z","load_balancing_strategy":"primary","db_duration_s":0.008621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 366.395800] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b44945a1ab9f56f02ac5d133","created_at":"2026-09-04T07:45:03.639Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6390d6ea457db904206d9c659e157de","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.658Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b44945a1ab9f56f02ac5d133: start","job_status":"start","queue_duration_s":1.144316,"scheduling_latency_s":1.144372}1437gitlab # [ 366.490078] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b44945a1ab9f56f02ac5d133","created_at":"2026-09-04T07:45:03.639Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6390d6ea457db904206d9c659e157de","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.658Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b44945a1ab9f56f02ac5d133: done: 0.144839 sec","job_status":"done","queue_duration_s":1.144316,"scheduling_latency_s":1.144372,"redis_calls":8,"redis_duration_s":0.006983,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000397,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001849,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.144839,"completed_at":"2026-09-04T07:45:04.947Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 366.576864] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:04.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"39b5bf2b0616ad9878d78eaf","created_at":"2026-09-04T07:45:03.741Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8187a02611afd82892f3ef8cf0b7addd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.754Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-39b5bf2b0616ad9878d78eaf: start","job_status":"start","queue_duration_s":1.198778,"scheduling_latency_s":1.198834}1439gitlab # [ 366.593059] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:05.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"39b5bf2b0616ad9878d78eaf","created_at":"2026-09-04T07:45:03.741Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8187a02611afd82892f3ef8cf0b7addd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.754Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-39b5bf2b0616ad9878d78eaf: done: 0.061972 sec","job_status":"done","queue_duration_s":1.198778,"scheduling_latency_s":1.198834,"redis_calls":10,"redis_duration_s":0.005193,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00124116,"exclusive_lock_hold_duration_s":0.01006308,"duration_s":0.061972,"completed_at":"2026-09-04T07:45:05.015Z","load_balancing_strategy":"primary","db_duration_s":0.00284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 366.635998] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:05.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5b33181236cf8e18246c87f7","created_at":"2026-09-04T07:45:03.808Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dad3d54d490aef6736b919f6626fc9e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.820Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5b33181236cf8e18246c87f7: start","job_status":"start","queue_duration_s":1.199258,"scheduling_latency_s":1.199298}1441gitlab # [ 367.457358] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:05.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5b33181236cf8e18246c87f7","created_at":"2026-09-04T07:45:03.808Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dad3d54d490aef6736b919f6626fc9e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.820Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5b33181236cf8e18246c87f7: done: 0.893145 sec","job_status":"done","queue_duration_s":1.199258,"scheduling_latency_s":1.199298,"redis_calls":563,"redis_duration_s":0.203915,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002566,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.200879,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.776431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.893145,"completed_at":"2026-09-04T07:45:05.912Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 367.461502] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:05.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9175c203313c13edbd7e93be","created_at":"2026-09-04T07:45:03.845Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ea2941470de7be248da2e6f8bc5d6a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.859Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9175c203313c13edbd7e93be: start","job_status":"start","queue_duration_s":2.061458,"scheduling_latency_s":2.061517}1443gitlab # [ 367.551336] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:05.962Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1444gitlab # [ 367.554793] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:05.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9175c203313c13edbd7e93be","created_at":"2026-09-04T07:45:03.845Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ea2941470de7be248da2e6f8bc5d6a6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.859Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9175c203313c13edbd7e93be: done: 0.062688 sec","job_status":"done","queue_duration_s":2.061458,"scheduling_latency_s":2.061517,"redis_calls":8,"redis_duration_s":0.00474,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000459,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062688,"completed_at":"2026-09-04T07:45:05.983Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 367.597289] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:05.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"c60d0c8a5fcc4b4ce25c38c7","created_at":"2026-09-04T07:45:03.916Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08c1581a18fbe0edd7be492de6fb83ce","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.936Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-c60d0c8a5fcc4b4ce25c38c7: start","job_status":"start","queue_duration_s":2.051676,"scheduling_latency_s":2.051716}1446gitlab # [ 367.610606] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"c60d0c8a5fcc4b4ce25c38c7","created_at":"2026-09-04T07:45:03.916Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08c1581a18fbe0edd7be492de6fb83ce","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.936Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-c60d0c8a5fcc4b4ce25c38c7: done: 0.061499 sec","job_status":"done","queue_duration_s":2.051676,"scheduling_latency_s":2.051716,"redis_calls":10,"redis_duration_s":0.0035190000000000004,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00071,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044222,"duration_s":0.061499,"completed_at":"2026-09-04T07:45:06.049Z","load_balancing_strategy":"primary","db_duration_s":0.006426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 367.652445] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c00b27e38e1132e428adc521","created_at":"2026-09-04T07:45:03.961Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceda36cbc3e299ebace1f4c33191d324","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.975Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c00b27e38e1132e428adc521: start","job_status":"start","queue_duration_s":2.076423,"scheduling_latency_s":2.076459}1448gitlab # [ 367.666500] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c00b27e38e1132e428adc521","created_at":"2026-09-04T07:45:03.961Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ceda36cbc3e299ebace1f4c33191d324","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:03.975Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c00b27e38e1132e428adc521: done: 0.067195 sec","job_status":"done","queue_duration_s":2.076423,"scheduling_latency_s":2.076459,"redis_calls":8,"redis_duration_s":0.005520000000000001,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000221,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.067195,"completed_at":"2026-09-04T07:45:06.119Z","load_balancing_strategy":"primary","db_duration_s":0.010143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 367.709787] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"24950eb2a110557fd69e04ef","created_at":"2026-09-04T07:45:04.014Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f07c5f18092ac5a31aa7096455c37a2e","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.036Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-24950eb2a110557fd69e04ef: start","job_status":"start","queue_duration_s":2.089299,"scheduling_latency_s":2.089364}1450gitlab # [ 367.792641] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"24950eb2a110557fd69e04ef","created_at":"2026-09-04T07:45:04.014Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f07c5f18092ac5a31aa7096455c37a2e","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.036Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-24950eb2a110557fd69e04ef: done: 0.125571 sec","job_status":"done","queue_duration_s":2.089299,"scheduling_latency_s":2.089364,"redis_calls":10,"redis_duration_s":0.007599,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001125,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00441,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00096588,"duration_s":0.125571,"completed_at":"2026-09-04T07:45:06.251Z","load_balancing_strategy":"primary","db_duration_s":0.013357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 367.856277] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a01700dfc5a007684eb0e45d","created_at":"2026-09-04T07:45:04.047Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e32d6c0ee833bba5ac00467976610d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.059Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a01700dfc5a007684eb0e45d: start","job_status":"start","queue_duration_s":2.196088,"scheduling_latency_s":2.196136}1452gitlab # [ 367.872220] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.330Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"a01700dfc5a007684eb0e45d","created_at":"2026-09-04T07:45:04.047Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e32d6c0ee833bba5ac00467976610d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.059Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-a01700dfc5a007684eb0e45d: done: 0.075333 sec","job_status":"done","queue_duration_s":2.196088,"scheduling_latency_s":2.196136,"redis_calls":11,"redis_duration_s":0.005384,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001987,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002474,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075333,"completed_at":"2026-09-04T07:45:06.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 367.914538] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b0d00670d5b6826777fbc996","created_at":"2026-09-04T07:45:04.100Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"811d441b9f75de8f76a86ec9974d899d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.123Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b0d00670d5b6826777fbc996: start","job_status":"start","queue_duration_s":2.211284,"scheduling_latency_s":2.21133}1454gitlab # [ 367.984241] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b0d00670d5b6826777fbc996","created_at":"2026-09-04T07:45:04.100Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"811d441b9f75de8f76a86ec9974d899d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.123Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b0d00670d5b6826777fbc996: done: 0.106967 sec","job_status":"done","queue_duration_s":2.211284,"scheduling_latency_s":2.21133,"redis_calls":10,"redis_duration_s":0.005403,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000322,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053901,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0020105,"exclusive_lock_hold_duration_s":0.04640738,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.106967,"completed_at":"2026-09-04T07:45:06.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 368.063727] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3ea83e9405c7a554c0f796eb","created_at":"2026-09-04T07:45:04.145Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1074b51f4c28481feb5de6c4fd7f8fda","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.167Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3ea83e9405c7a554c0f796eb: start","job_status":"start","queue_duration_s":2.27964,"scheduling_latency_s":2.279731}1456gitlab # [ 368.080286] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"3ea83e9405c7a554c0f796eb","created_at":"2026-09-04T07:45:04.145Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1074b51f4c28481feb5de6c4fd7f8fda","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.167Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-3ea83e9405c7a554c0f796eb: done: 0.064482 sec","job_status":"done","queue_duration_s":2.27964,"scheduling_latency_s":2.279731,"redis_calls":11,"redis_duration_s":0.006347,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000306,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003161,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00288,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0125498,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.064482,"completed_at":"2026-09-04T07:45:06.511Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006832,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1457gitlab # [ 368.124587] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3bc57c56149c54fdb762ab28","created_at":"2026-09-04T07:45:04.190Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.203Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3bc57c56149c54fdb762ab28: start","job_status":"start","queue_duration_s":2.312124,"scheduling_latency_s":2.312158}1458gitlab # [ 368.250495] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.708Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3bc57c56149c54fdb762ab28","created_at":"2026-09-04T07:45:04.190Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.203Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3bc57c56149c54fdb762ab28: done: 0.193146 sec","job_status":"done","queue_duration_s":2.312124,"scheduling_latency_s":2.312158,"redis_calls":65,"redis_duration_s":0.029375,"redis_read_bytes":748,"redis_write_bytes":41452,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.00163,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.001853,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.023455,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.160651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.193146,"completed_at":"2026-09-04T07:45:06.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 368.296896] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"68d4444c38f949dba3a8d067","created_at":"2026-09-04T07:45:04.254Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bab2d8122883f6683fea7ead45d722e4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.287Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-68d4444c38f949dba3a8d067: start","job_status":"start","queue_duration_s":2.426772,"scheduling_latency_s":2.426841}1460gitlab # [ 368.387407] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"68d4444c38f949dba3a8d067","created_at":"2026-09-04T07:45:04.254Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bab2d8122883f6683fea7ead45d722e4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.287Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-68d4444c38f949dba3a8d067: done: 0.131371 sec","job_status":"done","queue_duration_s":2.426772,"scheduling_latency_s":2.426841,"redis_calls":11,"redis_duration_s":0.009828,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002862,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00168268,"duration_s":0.131371,"completed_at":"2026-09-04T07:45:06.845Z","load_balancing_strategy":"primary","db_duration_s":0.009942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 368.466521] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9f1029523208bc466054b5fb","created_at":"2026-09-04T07:45:04.301Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41c0716d751b322a28e3820381da413e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.313Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9f1029523208bc466054b5fb: start","job_status":"start","queue_duration_s":2.538717,"scheduling_latency_s":2.538807}1462gitlab # [ 368.483818] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9f1029523208bc466054b5fb","created_at":"2026-09-04T07:45:04.301Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41c0716d751b322a28e3820381da413e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.313Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9f1029523208bc466054b5fb: done: 0.058681 sec","job_status":"done","queue_duration_s":2.538717,"scheduling_latency_s":2.538807,"redis_calls":8,"redis_duration_s":0.004488,"redis_read_bytes":133,"redis_write_bytes":943,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.058681,"completed_at":"2026-09-04T07:45:06.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 368.528185] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:06.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7f41add4f637f9510e04750d","created_at":"2026-09-04T07:45:04.348Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c07c7b14390be71837799e7b09fb1280","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.359Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7f41add4f637f9510e04750d: start","job_status":"start","queue_duration_s":2.554239,"scheduling_latency_s":2.554279}1464gitlab # [ 369.012326] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7f41add4f637f9510e04750d","created_at":"2026-09-04T07:45:04.348Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c07c7b14390be71837799e7b09fb1280","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.359Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7f41add4f637f9510e04750d: done: 0.55716 sec","job_status":"done","queue_duration_s":2.554239,"scheduling_latency_s":2.554279,"redis_calls":10,"redis_duration_s":0.004455,"redis_read_bytes":135,"redis_write_bytes":1071,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002178,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.089,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.438718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00163098,"exclusive_lock_hold_duration_s":0.51889212,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.55716,"completed_at":"2026-09-04T07:45:07.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.141769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 369.112347] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b70106f35d1461be8c624fcb","created_at":"2026-09-04T07:45:04.380Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d98ddd56213b84965f2328ff0699de20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:45:04.389Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b70106f35d1461be8c624fcb: start","job_status":"start","queue_duration_s":3.08471,"scheduling_latency_s":3.08477}1466gitlab # [ 369.128891] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.491Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1467gitlab # [ 369.133140] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b70106f35d1461be8c624fcb","created_at":"2026-09-04T07:45:04.380Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d98ddd56213b84965f2328ff0699de20","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:45:04.389Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b70106f35d1461be8c624fcb: done: 0.028133 sec","job_status":"done","queue_duration_s":3.08471,"scheduling_latency_s":3.08477,"redis_calls":8,"redis_duration_s":0.003274,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000371,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000704,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028133,"completed_at":"2026-09-04T07:45:07.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 369.178952] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"ff50c2c78058988d17a8e420","created_at":"2026-09-04T07:45:04.434Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20e652eec1dd3fc48d0c7e1ec6025208","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.485Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-ff50c2c78058988d17a8e420: start","job_status":"start","queue_duration_s":3.019863,"scheduling_latency_s":3.019894}1469gitlab # [ 369.194666] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"ff50c2c78058988d17a8e420","created_at":"2026-09-04T07:45:04.434Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20e652eec1dd3fc48d0c7e1ec6025208","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.485Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-ff50c2c78058988d17a8e420: done: 0.083659 sec","job_status":"done","queue_duration_s":3.019863,"scheduling_latency_s":3.019894,"redis_calls":11,"redis_duration_s":0.006916,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001202,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0018489,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.083659,"completed_at":"2026-09-04T07:45:07.588Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 369.239121] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ccbaf232c11e5c9c559a7248","created_at":"2026-09-04T07:45:04.526Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287f449199dddd9af0a0af2904f865fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.562Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ccbaf232c11e5c9c559a7248: start","job_status":"start","queue_duration_s":3.033465,"scheduling_latency_s":3.033599}1471gitlab # [ 369.273340] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ccbaf232c11e5c9c559a7248","created_at":"2026-09-04T07:45:04.526Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"287f449199dddd9af0a0af2904f865fb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.562Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ccbaf232c11e5c9c559a7248: done: 0.136912 sec","job_status":"done","queue_duration_s":3.033465,"scheduling_latency_s":3.033599,"redis_calls":10,"redis_duration_s":0.016441,"redis_read_bytes":135,"redis_write_bytes":1267,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.003653,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":105,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0065145,"exclusive_lock_hold_duration_s":0.06126128,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.136912,"completed_at":"2026-09-04T07:45:07.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 369.322808] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.736Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e8c3b71389a09f94e25f7b6f","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e8c3b71389a09f94e25f7b6f: start","job_status":"start","queue_duration_s":3.072531,"scheduling_latency_s":3.072566}1473gitlab # [ 369.335492] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.771Z","message":"No existing merge request to be cleaned up."}1474gitlab # [ 369.338101] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.797Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e8c3b71389a09f94e25f7b6f","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e8c3b71389a09f94e25f7b6f: done: 0.060622 sec","job_status":"done","queue_duration_s":3.072531,"scheduling_latency_s":3.072566,"redis_calls":11,"redis_duration_s":0.005505,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003002,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060622,"completed_at":"2026-09-04T07:45:07.797Z","load_balancing_strategy":"primary","db_duration_s":0.008024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 369.378909] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.800Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03a58eea5dfe01e929320af8","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03a58eea5dfe01e929320af8: start","job_status":"start","queue_duration_s":3.136332,"scheduling_latency_s":3.136392}1476gitlab # [ 369.392604] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.826Z","message":"No existing merge request to be cleaned up."}1477gitlab # [ 369.394291] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.844Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"03a58eea5dfe01e929320af8","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-03a58eea5dfe01e929320af8: done: 0.044711 sec","job_status":"done","queue_duration_s":3.136332,"scheduling_latency_s":3.136392,"redis_calls":10,"redis_duration_s":0.004288,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001645,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002643,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044711,"completed_at":"2026-09-04T07:45:07.844Z","load_balancing_strategy":"primary","db_duration_s":0.004875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 369.433172] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.848Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3842cae3069a94823799432a","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3842cae3069a94823799432a: start","job_status":"start","queue_duration_s":3.184344,"scheduling_latency_s":3.184376}1479gitlab # [ 369.445800] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.871Z","message":"No existing merge request to be cleaned up."}1480gitlab # [ 369.447505] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.889Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3842cae3069a94823799432a","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3842cae3069a94823799432a: done: 0.041653 sec","job_status":"done","queue_duration_s":3.184344,"scheduling_latency_s":3.184376,"redis_calls":10,"redis_duration_s":0.004249,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002441,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041653,"completed_at":"2026-09-04T07:45:07.889Z","load_balancing_strategy":"primary","db_duration_s":0.004379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 369.489327] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.892Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4763cc663424e7a66269b7e8","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4763cc663424e7a66269b7e8: start","job_status":"start","queue_duration_s":3.228437,"scheduling_latency_s":3.228484}1482gitlab # [ 369.527580] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.915Z","message":"No existing merge request to be cleaned up."}1483gitlab # [ 369.532479] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.935Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4763cc663424e7a66269b7e8","created_at":"2026-09-04T07:45:04.527Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-3c057f11c2e646d9","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"9e9732e5dfa4c0a58d0fefaf86381942","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.663Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4763cc663424e7a66269b7e8: done: 0.042779 sec","job_status":"done","queue_duration_s":3.228437,"scheduling_latency_s":3.228484,"redis_calls":10,"redis_duration_s":0.0051389999999999995,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00315,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042779,"completed_at":"2026-09-04T07:45:07.935Z","load_balancing_strategy":"primary","db_duration_s":0.004205,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 369.595186] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"98b6a58367e057ba863c9d12","created_at":"2026-09-04T07:45:04.661Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"800b6228af72d0499e88b51b9363fc26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.691Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-98b6a58367e057ba863c9d12: start","job_status":"start","queue_duration_s":3.245878,"scheduling_latency_s":3.245904}1485gitlab # [ 369.614039] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.954Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1486gitlab # [ 369.618670] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"98b6a58367e057ba863c9d12","created_at":"2026-09-04T07:45:04.661Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"800b6228af72d0499e88b51b9363fc26","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.691Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-98b6a58367e057ba863c9d12: done: 0.026426 sec","job_status":"done","queue_duration_s":3.245878,"scheduling_latency_s":3.245904,"redis_calls":7,"redis_duration_s":0.005387,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004916,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026426,"completed_at":"2026-09-04T07:45:07.963Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 369.665713] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7fd08b2b82631780e36cd045","created_at":"2026-09-04T07:45:04.728Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c6e0852b61199b3d97164e3f531480b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.746Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7fd08b2b82631780e36cd045: start","job_status":"start","queue_duration_s":3.220784,"scheduling_latency_s":3.220826}1488gitlab # [ 369.680708] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7fd08b2b82631780e36cd045","created_at":"2026-09-04T07:45:04.728Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c6e0852b61199b3d97164e3f531480b","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.746Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7fd08b2b82631780e36cd045: done: 0.028981 sec","job_status":"done","queue_duration_s":3.220784,"scheduling_latency_s":3.220826,"redis_calls":9,"redis_duration_s":0.002738,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006822,"exclusive_lock_hold_duration_s":0.00428034,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.028981,"completed_at":"2026-09-04T07:45:07.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000938,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 369.723536] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:07.998Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"4faa34b9aad7e00710c8dcc3","created_at":"2026-09-04T07:45:04.787Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e26fda7d2ef5081d62ddb3fc664279d","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.813Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-4faa34b9aad7e00710c8dcc3: start","job_status":"start","queue_duration_s":3.184482,"scheduling_latency_s":3.184504}1490gitlab # [ 369.738406] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"4faa34b9aad7e00710c8dcc3","created_at":"2026-09-04T07:45:04.787Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-98094ff876184530","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6e26fda7d2ef5081d62ddb3fc664279d","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:04.813Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-4faa34b9aad7e00710c8dcc3: done: 0.037373 sec","job_status":"done","queue_duration_s":3.184482,"scheduling_latency_s":3.184504,"redis_calls":11,"redis_duration_s":0.003801,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002091,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007676,"duration_s":0.037373,"completed_at":"2026-09-04T07:45:08.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001076,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 369.782090] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28554817859f70778e779d38","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28554817859f70778e779d38: start","job_status":"start","queue_duration_s":1.358899,"scheduling_latency_s":1.358921}1492gitlab # [ 369.795362] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28554817859f70778e779d38","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28554817859f70778e779d38: done: 0.027027 sec","job_status":"done","queue_duration_s":1.358899,"scheduling_latency_s":1.358921,"redis_calls":13,"redis_duration_s":0.0030299999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027027,"completed_at":"2026-09-04T07:45:08.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 369.838090] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b049925392c92c8eaec29d56","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b049925392c92c8eaec29d56: start","job_status":"start","queue_duration_s":1.387988,"scheduling_latency_s":1.388012}1494gitlab # [ 369.850968] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b049925392c92c8eaec29d56","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b049925392c92c8eaec29d56: done: 0.031083 sec","job_status":"done","queue_duration_s":1.387988,"scheduling_latency_s":1.388012,"redis_calls":13,"redis_duration_s":0.003339,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031083,"completed_at":"2026-09-04T07:45:08.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 369.892301] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f504fb240c919ad7a7af5e73","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f504fb240c919ad7a7af5e73: start","job_status":"start","queue_duration_s":1.421078,"scheduling_latency_s":1.421104}1496gitlab # [ 369.905215] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f504fb240c919ad7a7af5e73","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f504fb240c919ad7a7af5e73: done: 0.02822 sec","job_status":"done","queue_duration_s":1.421078,"scheduling_latency_s":1.421104,"redis_calls":13,"redis_duration_s":0.0030350000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02822,"completed_at":"2026-09-04T07:45:08.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497gitlab # [ 369.945364] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bbef4c564fe19e6a95bf33a","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bbef4c564fe19e6a95bf33a: start","job_status":"start","queue_duration_s":1.450958,"scheduling_latency_s":1.45098}1498gitlab # [ 369.958073] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bbef4c564fe19e6a95bf33a","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bbef4c564fe19e6a95bf33a: done: 0.028215 sec","job_status":"done","queue_duration_s":1.450958,"scheduling_latency_s":1.45098,"redis_calls":13,"redis_duration_s":0.003027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001047,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028215,"completed_at":"2026-09-04T07:45:08.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 369.998194] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"784957619630f09a2594ebe2","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-784957619630f09a2594ebe2: start","job_status":"start","queue_duration_s":1.481374,"scheduling_latency_s":1.4814}1500gitlab # [ 370.011114] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"784957619630f09a2594ebe2","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-784957619630f09a2594ebe2: done: 0.023267 sec","job_status":"done","queue_duration_s":1.481374,"scheduling_latency_s":1.4814,"redis_calls":13,"redis_duration_s":0.002205,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001455,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023267,"completed_at":"2026-09-04T07:45:08.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 370.052811] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bb767a29e2c9a65a922fabf","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bb767a29e2c9a65a922fabf: start","job_status":"start","queue_duration_s":1.506761,"scheduling_latency_s":1.506783}1502gitlab # [ 370.065523] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bb767a29e2c9a65a922fabf","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bb767a29e2c9a65a922fabf: done: 0.024583 sec","job_status":"done","queue_duration_s":1.506761,"scheduling_latency_s":1.506783,"redis_calls":13,"redis_duration_s":0.002798,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024583,"completed_at":"2026-09-04T07:45:08.210Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 370.105439] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cedbabda7d0f5afb72eb73e0","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cedbabda7d0f5afb72eb73e0: start","job_status":"start","queue_duration_s":1.533352,"scheduling_latency_s":1.533377}1504gitlab # [ 370.118283] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cedbabda7d0f5afb72eb73e0","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cedbabda7d0f5afb72eb73e0: done: 0.025436 sec","job_status":"done","queue_duration_s":1.533352,"scheduling_latency_s":1.533377,"redis_calls":13,"redis_duration_s":0.002787,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025436,"completed_at":"2026-09-04T07:45:08.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 370.158528] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbe7bb1bbd97c82e76879a50","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbe7bb1bbd97c82e76879a50: start","job_status":"start","queue_duration_s":1.56125,"scheduling_latency_s":1.561271}1506gitlab # [ 370.171355] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.268Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbe7bb1bbd97c82e76879a50","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbe7bb1bbd97c82e76879a50: done: 0.028455 sec","job_status":"done","queue_duration_s":1.56125,"scheduling_latency_s":1.561271,"redis_calls":13,"redis_duration_s":0.003064,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028455,"completed_at":"2026-09-04T07:45:08.268Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 370.211872] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e9e66b070cbe78157bbfbd7","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e9e66b070cbe78157bbfbd7: start","job_status":"start","queue_duration_s":1.591688,"scheduling_latency_s":1.591711}1508gitlab # [ 370.225947] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e9e66b070cbe78157bbfbd7","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e9e66b070cbe78157bbfbd7: done: 0.03111 sec","job_status":"done","queue_duration_s":1.591688,"scheduling_latency_s":1.591711,"redis_calls":13,"redis_duration_s":0.003273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03111,"completed_at":"2026-09-04T07:45:08.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 370.266121] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5440e99b4ac398cd2453885","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5440e99b4ac398cd2453885: start","job_status":"start","queue_duration_s":1.625244,"scheduling_latency_s":1.625342}1510gitlab # [ 370.278952] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5440e99b4ac398cd2453885","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5440e99b4ac398cd2453885: done: 0.030243 sec","job_status":"done","queue_duration_s":1.625244,"scheduling_latency_s":1.625342,"redis_calls":14,"redis_duration_s":0.002927,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000173,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030243,"completed_at":"2026-09-04T07:45:08.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 370.320963] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b8b4eb021f93f014a4a37f0","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b8b4eb021f93f014a4a37f0: start","job_status":"start","queue_duration_s":1.657172,"scheduling_latency_s":1.657202}1512gitlab # [ 370.333620] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b8b4eb021f93f014a4a37f0","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b8b4eb021f93f014a4a37f0: done: 0.332963 sec","job_status":"done","queue_duration_s":1.657172,"scheduling_latency_s":1.657202,"redis_calls":13,"redis_duration_s":0.003147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.332963,"completed_at":"2026-09-04T07:45:08.668Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513gitlab # [ 370.373998] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"838014f733750e0a9b5659f9","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-838014f733750e0a9b5659f9: start","job_status":"start","queue_duration_s":1.992505,"scheduling_latency_s":1.992533}1514gitlab # [ 370.386976] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"838014f733750e0a9b5659f9","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-838014f733750e0a9b5659f9: done: 0.032085 sec","job_status":"done","queue_duration_s":1.992505,"scheduling_latency_s":1.992533,"redis_calls":13,"redis_duration_s":0.0028799999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032085,"completed_at":"2026-09-04T07:45:08.703Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515gitlab # [ 370.427812] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b2dfdf5f793c803691f6528","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b2dfdf5f793c803691f6528: start","job_status":"start","queue_duration_s":2.027221,"scheduling_latency_s":2.027249}1516gitlab # [ 370.442170] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.736Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b2dfdf5f793c803691f6528","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b2dfdf5f793c803691f6528: done: 0.02995 sec","job_status":"done","queue_duration_s":2.027221,"scheduling_latency_s":2.027249,"redis_calls":13,"redis_duration_s":0.003225,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002359,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02995,"completed_at":"2026-09-04T07:45:08.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 370.482431] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37431940e16060ed4c1ba459","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37431940e16060ed4c1ba459: start","job_status":"start","queue_duration_s":2.059188,"scheduling_latency_s":2.059213}1518gitlab # [ 370.496002] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37431940e16060ed4c1ba459","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37431940e16060ed4c1ba459: done: 0.025706 sec","job_status":"done","queue_duration_s":2.059188,"scheduling_latency_s":2.059213,"redis_calls":13,"redis_duration_s":0.003028,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001767,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025706,"completed_at":"2026-09-04T07:45:08.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 370.536191] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16da50810c8f3043fbbe9cf4","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16da50810c8f3043fbbe9cf4: start","job_status":"start","queue_duration_s":2.087191,"scheduling_latency_s":2.087218}1520gitlab # [ 370.548950] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16da50810c8f3043fbbe9cf4","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16da50810c8f3043fbbe9cf4: done: 0.029304 sec","job_status":"done","queue_duration_s":2.087191,"scheduling_latency_s":2.087218,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029304,"completed_at":"2026-09-04T07:45:08.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 370.588967] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14dde8362dd3e646b95b1dd2","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14dde8362dd3e646b95b1dd2: start","job_status":"start","queue_duration_s":2.120256,"scheduling_latency_s":2.12028}1522gitlab # [ 370.601708] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14dde8362dd3e646b95b1dd2","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14dde8362dd3e646b95b1dd2: done: 0.02783 sec","job_status":"done","queue_duration_s":2.120256,"scheduling_latency_s":2.12028,"redis_calls":13,"redis_duration_s":0.002552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001678,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02783,"completed_at":"2026-09-04T07:45:08.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 370.643014] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"915e3683c4b0fe93eb15c073","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-915e3683c4b0fe93eb15c073: start","job_status":"start","queue_duration_s":2.150837,"scheduling_latency_s":2.150862}1524gitlab # [ 370.655858] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"915e3683c4b0fe93eb15c073","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-915e3683c4b0fe93eb15c073: done: 0.025972 sec","job_status":"done","queue_duration_s":2.150837,"scheduling_latency_s":2.150862,"redis_calls":13,"redis_duration_s":0.003136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025972,"completed_at":"2026-09-04T07:45:08.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 370.696062] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"833bafed1013ea70137d4c8e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-833bafed1013ea70137d4c8e: start","job_status":"start","queue_duration_s":2.178692,"scheduling_latency_s":2.178716}1526gitlab # [ 370.708669] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"833bafed1013ea70137d4c8e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-833bafed1013ea70137d4c8e: done: 0.026371 sec","job_status":"done","queue_duration_s":2.178692,"scheduling_latency_s":2.178716,"redis_calls":13,"redis_duration_s":0.0023279999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001447,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026371,"completed_at":"2026-09-04T07:45:08.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 370.748804] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2245d61692887176217f97a2","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2245d61692887176217f97a2: start","job_status":"start","queue_duration_s":2.207592,"scheduling_latency_s":2.207615}1528gitlab # [ 370.761220] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2245d61692887176217f97a2","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2245d61692887176217f97a2: done: 0.028482 sec","job_status":"done","queue_duration_s":2.207592,"scheduling_latency_s":2.207615,"redis_calls":13,"redis_duration_s":0.002567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001578,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028482,"completed_at":"2026-09-04T07:45:08.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529gitlab # [ 370.801811] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44583cbd672d07f61ac8ec49","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44583cbd672d07f61ac8ec49: start","job_status":"start","queue_duration_s":2.240261,"scheduling_latency_s":2.240286}1530gitlab # [ 370.814733] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44583cbd672d07f61ac8ec49","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44583cbd672d07f61ac8ec49: done: 0.030551 sec","job_status":"done","queue_duration_s":2.240261,"scheduling_latency_s":2.240286,"redis_calls":13,"redis_duration_s":0.003187,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002317,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030551,"completed_at":"2026-09-04T07:45:08.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531gitlab # [ 370.856095] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"906af4d612cefb12e3e1711e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-906af4d612cefb12e3e1711e: start","job_status":"start","queue_duration_s":2.27355,"scheduling_latency_s":2.273574}1532gitlab # [ 370.868755] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"906af4d612cefb12e3e1711e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-906af4d612cefb12e3e1711e: done: 0.03192 sec","job_status":"done","queue_duration_s":2.27355,"scheduling_latency_s":2.273574,"redis_calls":13,"redis_duration_s":0.0031720000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03192,"completed_at":"2026-09-04T07:45:08.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533gitlab # [ 370.908862] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:08.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43946998fcddb4a5e6d89450","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43946998fcddb4a5e6d89450: start","job_status":"start","queue_duration_s":2.307327,"scheduling_latency_s":2.30736}1534gitlab # [ 370.921478] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43946998fcddb4a5e6d89450","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43946998fcddb4a5e6d89450: done: 0.031143 sec","job_status":"done","queue_duration_s":2.307327,"scheduling_latency_s":2.30736,"redis_calls":13,"redis_duration_s":0.002663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031143,"completed_at":"2026-09-04T07:45:09.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535gitlab # [ 370.961297] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47d574a16548184690727d7e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47d574a16548184690727d7e: start","job_status":"start","queue_duration_s":2.340141,"scheduling_latency_s":2.340166}1536gitlab # [ 370.974102] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47d574a16548184690727d7e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47d574a16548184690727d7e: done: 0.027835 sec","job_status":"done","queue_duration_s":2.340141,"scheduling_latency_s":2.340166,"redis_calls":13,"redis_duration_s":0.002552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001523,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027835,"completed_at":"2026-09-04T07:45:09.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 371.014373] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"231c8c38aaa59090b14189bb","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-231c8c38aaa59090b14189bb: start","job_status":"start","queue_duration_s":2.369981,"scheduling_latency_s":2.370005}1538gitlab # [ 371.027109] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"231c8c38aaa59090b14189bb","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-231c8c38aaa59090b14189bb: done: 0.026176 sec","job_status":"done","queue_duration_s":2.369981,"scheduling_latency_s":2.370005,"redis_calls":13,"redis_duration_s":0.002353,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000874,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026176,"completed_at":"2026-09-04T07:45:09.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 371.068563] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01ab628d1696abfaa59c7337","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01ab628d1696abfaa59c7337: start","job_status":"start","queue_duration_s":2.398185,"scheduling_latency_s":2.398207}1540gitlab # [ 371.081110] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01ab628d1696abfaa59c7337","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01ab628d1696abfaa59c7337: done: 0.026191 sec","job_status":"done","queue_duration_s":2.398185,"scheduling_latency_s":2.398207,"redis_calls":13,"redis_duration_s":0.002438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001469,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026191,"completed_at":"2026-09-04T07:45:09.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541gitlab # [ 371.121031] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.104Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faccf2fac8b481367ed4e99c","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faccf2fac8b481367ed4e99c: start","job_status":"start","queue_duration_s":2.426047,"scheduling_latency_s":2.42607}1542gitlab # [ 371.133562] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faccf2fac8b481367ed4e99c","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faccf2fac8b481367ed4e99c: done: 0.029679 sec","job_status":"done","queue_duration_s":2.426047,"scheduling_latency_s":2.42607,"redis_calls":13,"redis_duration_s":0.002448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001451,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029679,"completed_at":"2026-09-04T07:45:09.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 371.173249] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4addd3c1e00d06ed0818a55","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4addd3c1e00d06ed0818a55: start","job_status":"start","queue_duration_s":2.460231,"scheduling_latency_s":2.460256}1544gitlab # [ 371.185837] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4addd3c1e00d06ed0818a55","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4addd3c1e00d06ed0818a55: done: 0.027436 sec","job_status":"done","queue_duration_s":2.460231,"scheduling_latency_s":2.460256,"redis_calls":13,"redis_duration_s":0.002525,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001591,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027436,"completed_at":"2026-09-04T07:45:09.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 371.225733] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a606dbf964e67aedf81f3be","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a606dbf964e67aedf81f3be: start","job_status":"start","queue_duration_s":2.489631,"scheduling_latency_s":2.489684}1546gitlab # [ 371.238384] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a606dbf964e67aedf81f3be","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a606dbf964e67aedf81f3be: done: 0.033304 sec","job_status":"done","queue_duration_s":2.489631,"scheduling_latency_s":2.489684,"redis_calls":13,"redis_duration_s":0.003484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002258,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033304,"completed_at":"2026-09-04T07:45:09.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 371.280299] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e2f8bf6d646e799dbf78b12","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e2f8bf6d646e799dbf78b12: start","job_status":"start","queue_duration_s":2.525482,"scheduling_latency_s":2.525513}1548gitlab # [ 371.292858] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e2f8bf6d646e799dbf78b12","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e2f8bf6d646e799dbf78b12: done: 0.030144 sec","job_status":"done","queue_duration_s":2.525482,"scheduling_latency_s":2.525513,"redis_calls":13,"redis_duration_s":0.0029449999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030144,"completed_at":"2026-09-04T07:45:09.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 371.332825] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e82dda5b79c865f3c0b8eab3","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e82dda5b79c865f3c0b8eab3: start","job_status":"start","queue_duration_s":2.559371,"scheduling_latency_s":2.559399}1550gitlab # [ 371.345394] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e82dda5b79c865f3c0b8eab3","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e82dda5b79c865f3c0b8eab3: done: 0.031429 sec","job_status":"done","queue_duration_s":2.559371,"scheduling_latency_s":2.559399,"redis_calls":13,"redis_duration_s":0.0044729999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00277,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001703,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031429,"completed_at":"2026-09-04T07:45:09.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 371.384878] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc328056bc29a14e469b4f3","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc328056bc29a14e469b4f3: start","job_status":"start","queue_duration_s":2.59279,"scheduling_latency_s":2.592811}1552gitlab # [ 371.397530] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdc328056bc29a14e469b4f3","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdc328056bc29a14e469b4f3: done: 0.033293 sec","job_status":"done","queue_duration_s":2.59279,"scheduling_latency_s":2.592811,"redis_calls":13,"redis_duration_s":0.0029490000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033293,"completed_at":"2026-09-04T07:45:09.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 371.437478] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b938b0a5d09f9afcf8b88f3f","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b938b0a5d09f9afcf8b88f3f: start","job_status":"start","queue_duration_s":2.627913,"scheduling_latency_s":2.627936}1554gitlab # [ 371.451509] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b938b0a5d09f9afcf8b88f3f","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b938b0a5d09f9afcf8b88f3f: done: 0.031652 sec","job_status":"done","queue_duration_s":2.627913,"scheduling_latency_s":2.627936,"redis_calls":13,"redis_duration_s":0.002819,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031652,"completed_at":"2026-09-04T07:45:09.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 371.491559] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af83913d8a44edb8e48ae7bc","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af83913d8a44edb8e48ae7bc: start","job_status":"start","queue_duration_s":2.662055,"scheduling_latency_s":2.663879}1556gitlab # [ 371.504880] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af83913d8a44edb8e48ae7bc","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af83913d8a44edb8e48ae7bc: done: 0.031761 sec","job_status":"done","queue_duration_s":2.662055,"scheduling_latency_s":2.663879,"redis_calls":13,"redis_duration_s":0.0026100000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001783,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031761,"completed_at":"2026-09-04T07:45:09.372Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 371.544924] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25c365320d92dfe7c81f3aa","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25c365320d92dfe7c81f3aa: start","job_status":"start","queue_duration_s":2.69603,"scheduling_latency_s":2.696097}1558gitlab # [ 371.557490] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25c365320d92dfe7c81f3aa","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25c365320d92dfe7c81f3aa: done: 0.029906 sec","job_status":"done","queue_duration_s":2.69603,"scheduling_latency_s":2.696097,"redis_calls":13,"redis_duration_s":0.003518,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029906,"completed_at":"2026-09-04T07:45:09.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 371.596808] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d7218c650d2f8b41b278c11","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d7218c650d2f8b41b278c11: start","job_status":"start","queue_duration_s":2.727775,"scheduling_latency_s":2.727831}1560gitlab # [ 371.609392] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d7218c650d2f8b41b278c11","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d7218c650d2f8b41b278c11: done: 0.030983 sec","job_status":"done","queue_duration_s":2.727775,"scheduling_latency_s":2.727831,"redis_calls":13,"redis_duration_s":0.0033510000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002236,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022102,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030983,"completed_at":"2026-09-04T07:45:09.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 371.649268] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6a407c716a07dc53e4eaa51","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6a407c716a07dc53e4eaa51: start","job_status":"start","queue_duration_s":2.760719,"scheduling_latency_s":2.760742}1562gitlab # [ 371.663411] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6a407c716a07dc53e4eaa51","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6a407c716a07dc53e4eaa51: done: 0.025722 sec","job_status":"done","queue_duration_s":2.760719,"scheduling_latency_s":2.760742,"redis_calls":13,"redis_duration_s":0.0021869999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025722,"completed_at":"2026-09-04T07:45:09.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 371.703419] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1abd2c579d1f0b824bf156eb","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1abd2c579d1f0b824bf156eb: start","job_status":"start","queue_duration_s":2.790419,"scheduling_latency_s":2.79044}1564gitlab # [ 371.716363] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1abd2c579d1f0b824bf156eb","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1abd2c579d1f0b824bf156eb: done: 0.027391 sec","job_status":"done","queue_duration_s":2.790419,"scheduling_latency_s":2.79044,"redis_calls":13,"redis_duration_s":0.002916,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027391,"completed_at":"2026-09-04T07:45:09.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 371.756592] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"677c9ec0a796b8ec27ab0e75","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-677c9ec0a796b8ec27ab0e75: start","job_status":"start","queue_duration_s":2.81917,"scheduling_latency_s":2.819191}1566gitlab # [ 371.769160] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"677c9ec0a796b8ec27ab0e75","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-677c9ec0a796b8ec27ab0e75: done: 0.026392 sec","job_status":"done","queue_duration_s":2.81917,"scheduling_latency_s":2.819191,"redis_calls":13,"redis_duration_s":0.00258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026392,"completed_at":"2026-09-04T07:45:09.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 371.808635] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2768422fb6f7a080e2500e65","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2768422fb6f7a080e2500e65: start","job_status":"start","queue_duration_s":2.846965,"scheduling_latency_s":2.846986}1568gitlab # [ 371.821128] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2768422fb6f7a080e2500e65","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2768422fb6f7a080e2500e65: done: 0.030779 sec","job_status":"done","queue_duration_s":2.846965,"scheduling_latency_s":2.846986,"redis_calls":13,"redis_duration_s":0.002221,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030779,"completed_at":"2026-09-04T07:45:09.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 371.862192] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48235c7c171f89677efc15c6","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48235c7c171f89677efc15c6: start","job_status":"start","queue_duration_s":2.881624,"scheduling_latency_s":2.881647}1570gitlab # [ 371.874829] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48235c7c171f89677efc15c6","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48235c7c171f89677efc15c6: done: 0.029958 sec","job_status":"done","queue_duration_s":2.881624,"scheduling_latency_s":2.881647,"redis_calls":13,"redis_duration_s":0.0031839999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00225,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029958,"completed_at":"2026-09-04T07:45:09.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 371.915233] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4444d65e30f2f6829d5db37c","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4444d65e30f2f6829d5db37c: start","job_status":"start","queue_duration_s":2.913993,"scheduling_latency_s":2.914089}1572gitlab # [ 371.927910] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4444d65e30f2f6829d5db37c","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4444d65e30f2f6829d5db37c: done: 0.032912 sec","job_status":"done","queue_duration_s":2.913993,"scheduling_latency_s":2.914089,"redis_calls":13,"redis_duration_s":0.0032310000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032912,"completed_at":"2026-09-04T07:45:09.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 371.968086] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a54241c85f52cb07296283e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a54241c85f52cb07296283e: start","job_status":"start","queue_duration_s":2.949413,"scheduling_latency_s":2.949437}1574gitlab # [ 371.980607] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a54241c85f52cb07296283e","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a54241c85f52cb07296283e: done: 0.031063 sec","job_status":"done","queue_duration_s":2.949413,"scheduling_latency_s":2.949437,"redis_calls":13,"redis_duration_s":0.0031260000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031063,"completed_at":"2026-09-04T07:45:09.659Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 372.019885] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2a0c7163ed9cdf251892ece","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2a0c7163ed9cdf251892ece: start","job_status":"start","queue_duration_s":2.982911,"scheduling_latency_s":2.982936}1576gitlab # [ 372.032485] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2a0c7163ed9cdf251892ece","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2a0c7163ed9cdf251892ece: done: 0.032163 sec","job_status":"done","queue_duration_s":2.982911,"scheduling_latency_s":2.982936,"redis_calls":13,"redis_duration_s":0.0025599999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001521,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032163,"completed_at":"2026-09-04T07:45:09.693Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 372.073265] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8493432bcc733d4fbb8857c5","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8493432bcc733d4fbb8857c5: start","job_status":"start","queue_duration_s":3.016586,"scheduling_latency_s":3.016608}1578gitlab # [ 372.085705] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8493432bcc733d4fbb8857c5","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8493432bcc733d4fbb8857c5: done: 0.027399 sec","job_status":"done","queue_duration_s":3.016586,"scheduling_latency_s":3.016608,"redis_calls":13,"redis_duration_s":0.0029170000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027399,"completed_at":"2026-09-04T07:45:09.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 372.124862] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6434a23c50ce6cd4991b913f","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6434a23c50ce6cd4991b913f: start","job_status":"start","queue_duration_s":3.045594,"scheduling_latency_s":3.045616}1580gitlab # [ 372.137040] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6434a23c50ce6cd4991b913f","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6434a23c50ce6cd4991b913f: done: 0.028793 sec","job_status":"done","queue_duration_s":3.045594,"scheduling_latency_s":3.045616,"redis_calls":13,"redis_duration_s":0.002619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001658,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028793,"completed_at":"2026-09-04T07:45:09.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 372.176082] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8905b6c7689769b3f48d356d","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8905b6c7689769b3f48d356d: start","job_status":"start","queue_duration_s":3.076786,"scheduling_latency_s":3.076864}1582gitlab # [ 372.188371] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8905b6c7689769b3f48d356d","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8905b6c7689769b3f48d356d: done: 0.032273 sec","job_status":"done","queue_duration_s":3.076786,"scheduling_latency_s":3.076864,"redis_calls":13,"redis_duration_s":0.002869,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032273,"completed_at":"2026-09-04T07:45:09.787Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 372.227180] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294551ca550ccd320f275e17","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294551ca550ccd320f275e17: start","job_status":"start","queue_duration_s":3.111669,"scheduling_latency_s":3.111691}1584gitlab # [ 372.239867] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294551ca550ccd320f275e17","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294551ca550ccd320f275e17: done: 0.032588 sec","job_status":"done","queue_duration_s":3.111669,"scheduling_latency_s":3.111691,"redis_calls":13,"redis_duration_s":0.004592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003427,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032588,"completed_at":"2026-09-04T07:45:09.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 372.281185] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1ea67dfc6b86bea6be9826","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1ea67dfc6b86bea6be9826: start","job_status":"start","queue_duration_s":3.146057,"scheduling_latency_s":3.146135}1586gitlab # [ 372.293657] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1ea67dfc6b86bea6be9826","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1ea67dfc6b86bea6be9826: done: 0.029662 sec","job_status":"done","queue_duration_s":3.146057,"scheduling_latency_s":3.146135,"redis_calls":13,"redis_duration_s":0.0031119999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029662,"completed_at":"2026-09-04T07:45:09.854Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 372.333406] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57d65968bfd336263e63bfce","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57d65968bfd336263e63bfce: start","job_status":"start","queue_duration_s":3.177568,"scheduling_latency_s":3.177592}1588gitlab # [ 372.346026] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"57d65968bfd336263e63bfce","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-57d65968bfd336263e63bfce: done: 0.027964 sec","job_status":"done","queue_duration_s":3.177568,"scheduling_latency_s":3.177592,"redis_calls":13,"redis_duration_s":0.0031839999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027964,"completed_at":"2026-09-04T07:45:09.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 372.386030] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ba6adf584e2b6bba7c00640","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ba6adf584e2b6bba7c00640: start","job_status":"start","queue_duration_s":3.208857,"scheduling_latency_s":3.208881}1590gitlab # [ 372.398737] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:09.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ba6adf584e2b6bba7c00640","created_at":"2026-09-04T07:45:06.545Z","trace_propagation_headers":{"sentry-trace":"9b202e284db243b29b3fc8cbc52b246d-a96947dfc7e4475d","baggage":"sentry-trace_id=9b202e284db243b29b3fc8cbc52b246d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"45ca3b2aa758131dc474f7ceb0a4d74b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:06.678Z","job_size_bytes":2,"pid":2408,"sidekiq_tid":"m7sw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ba6adf584e2b6bba7c00640: done: 0.028231 sec","job_status":"done","queue_duration_s":3.208857,"scheduling_latency_s":3.208881,"redis_calls":13,"redis_duration_s":0.0031669999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019524,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028231,"completed_at":"2026-09-04T07:45:09.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 394.410545] postgres[3887]: [3887] ERROR: relation "table_without_models" does not exist1592gitlab # [ 394.411158] postgres[3887]: [3887] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1593gitlab # [ 400.517958] runuser[3511]: pam_unix(runuser:session): session closed for user gitlab1594gitlab # [ 400.520736] setup-gitlab-start[3496]: + systemctl restart gitlab-sidekiq.service1595gitlab # [ 400.564313] systemd[1]: Stopping gitlab-sidekiq.service...1596gitlab # [ 400.565893] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:39.023Z","message":"Shutting down"}1597gitlab # [ 400.567438] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:39.024Z","message":"Scheduler exiting..."}1598gitlab # [ 400.569045] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:39.025Z","message":"Terminating quiet threads for default capsule"}1599gitlab # [ 400.570832] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:39.025Z","message":"Scheduler exiting..."}1600gitlab # [ 401.067925] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:39.527Z","message":"Pausing to allow jobs to finish..."}1601gitlab # [ 402.072250] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:40.530Z","message":"Bye!"}1602gitlab # [ 402.114286] sidekiq-cluster[2408]: {"severity":"INFO","time":"2026-09-04T07:45:40.573Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2408,"worker_id":"sidekiq_0","memwd_rss_bytes":962949120,"retry":0}1603gitlab # [ 403.735863] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1604gitlab # [ 403.736369] systemd[1]: Stopped gitlab-sidekiq.service.1605gitlab # [ 403.736571] systemd[1]: gitlab-sidekiq.service: Consumed 2min 17.131s CPU time over 3min 52.646s wall clock time, 948.3M memory peak, 4.5M read from disk.1606gitlab # [ 403.750057] systemd[1]: Started gitlab-sidekiq.service.1607gitlab # [ 403.757682] setup-gitlab-start[3496]: + mkdir -p /var/lib/secrets1608gitlab # [ 403.765239] setup-gitlab-start[3496]: + echo nixbot-test-token-of-20-chars1609gitlab # [ 403.768424] setup-gitlab-start[3496]: + chmod 644 /var/lib/secrets/gitlab-token1610gitlab # [ 403.771410] setup-gitlab-start[3496]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1611gitlab # [ 405.097623] gitaly[986]: time="2026-09-04T07:45:43.555Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:53.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.554" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1612gitlab # [ 405.127790] gitaly[986]: time="2026-09-04T07:45:43.556Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:53.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.554" grpc.time_ms=1.521 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1613gitlab # [ 405.315936] gitaly[986]: time="2026-09-04T07:45:43.775Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:53.224" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.775" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1614gitlab # [ 405.381586] gitaly[986]: time="2026-09-04T07:45:43.775Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:53.224" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.775" grpc.time_ms=0.356 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1615gitlab # [ 405.406798] gitaly[986]: time="2026-09-04T07:45:43.866Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 diskcache=b50706ec-1da6-4bbe-99ba-cbcf6cdca2a1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:45:53.246" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.796" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1616gitlab # [ 405.421011] gitaly[986]: time="2026-09-04T07:45:43.867Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=46 command.spawn_token_fork_ms=8 command.system_time_ms=39 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:45:53.246" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.796" grpc.time_ms=70.25 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 405.457547] gitaly[986]: time="2026-09-04T07:45:43.917Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:53.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.916" pid=986 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1618gitlab # [ 405.489482] gitaly[986]: time="2026-09-04T07:45:43.917Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:53.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.916" grpc.time_ms=0.846 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 405.521917] gitaly[986]: time="2026-09-04T07:45:43.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:45:53.016" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:43.926" grpc.time_ms=11.928 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1620gitlab # [ 405.599836] gitaly[986]: time="2026-09-04T07:45:44.059Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:54.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.059" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 405.632797] gitaly[986]: time="2026-09-04T07:45:44.059Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:54.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.059" grpc.time_ms=0.715 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 405.689874] gitaly[986]: time="2026-09-04T07:45:44.149Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 diskcache=4e16ab62-e93c-47de-ab46-bc0d4261f846 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:45:54.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.074" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1623gitlab # [ 405.720533] gitaly[986]: time="2026-09-04T07:45:44.150Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=49 command.spawn_token_fork_ms=6 command.system_time_ms=34 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:45:54.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.074" grpc.time_ms=75.754 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1624gitlab # [ 405.751813] gitaly[986]: time="2026-09-04T07:45:44.181Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:54.128" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.180" pid=986 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1625gitlab # [ 405.773270] gitaly[986]: time="2026-09-04T07:45:44.182Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:54.128" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.180" grpc.time_ms=1.952 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 405.791293] gitaly[986]: time="2026-09-04T07:45:44.219Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:45:54.147" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.198" grpc.time_ms=20.313 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 405.866555] gitaly[986]: time="2026-09-04T07:45:44.326Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:45:54.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.325" grpc.time_ms=0.512 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1628gitlab # [ 405.902212] gitaly[986]: time="2026-09-04T07:45:44.361Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:45:54.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:44.358" grpc.time_ms=1.649 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1629gitlab # [ 406.947695] gitaly[986]: time="2026-09-04T07:45:45.406Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP2VBQRT1GTAZE5D6Y2C26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:45:55.035" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:45.386" grpc.time_ms=19.213 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1630gitlab # [ 409.470192] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:47 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 56651631gitlab # [ 409.472753] setup-gitlab-start[3496]: + mkdir -p /tmp/test-flake1632gitlab # [ 409.476717] setup-gitlab-start[3496]: + cd /tmp/test-flake1633gitlab # [ 409.477694] setup-gitlab-start[3496]: + git init -b master1634gitlab # [ 409.517549] setup-gitlab-start[4010]: Initialized empty Git repository in /tmp/test-flake/.git/1635gitlab # [ 409.519727] setup-gitlab-start[3496]: + git config user.name test1636gitlab # [ 409.526223] setup-gitlab-start[3496]: + git config user.email test@example.com1637gitlab # [ 409.534233] setup-gitlab-start[3496]: + cat1638gitlab # [ 409.540750] setup-gitlab-start[3496]: + git add flake.nix1639gitlab # [ 409.551481] setup-gitlab-start[3496]: + git commit -m 'initial commit'1640gitlab # [ 409.592272] setup-gitlab-start[4018]: [master (root-commit) 7b346bd] initial commit1641gitlab # [ 409.596491] setup-gitlab-start[4018]: 1 file changed, 10 insertions(+)1642gitlab # [ 409.599438] setup-gitlab-start[4018]: create mode 100644 flake.nix1643gitlab # [ 409.604079] setup-gitlab-start[3496]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1644gitlab # [ 409.610025] setup-gitlab-start[3496]: + git push -u origin master1645gitlab # [ 409.753795] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 861646gitlab # [ 409.967632] gitaly[986]: time="2026-09-04T07:45:48.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP315Q4E3349DKYTNFP3QF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:48.405" grpc.time_ms=21.147 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1647gitlab # [ 409.985779] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2151648gitlab # [ 410.285435] sidekiq-cluster[3950]: {"severity":"INFO","time":"2026-09-04T07:45:48.693Z","message":"Starting cluster with 1 processes"}1649gitlab # [ 411.020406] gitaly[986]: time="2026-09-04T07:45:49.479Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:45:59.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:49.462" grpc.time_ms=17.09 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1650gitlab # [ 411.134344] gitaly[986]: time="2026-09-04T07:45:49.594Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:46:19.073" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:45:49.573" grpc.time_ms=19.941 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1651gitlab # [ 411.222913] gitaly[986]: time="2026-09-04T07:45:49.682Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 duration_ms=963ns method=POST pid=986 status=200 url="http://unix/api/v4/internal/allowed"1652gitlab # [ 411.287791] gitaly[986]: time="2026-09-04T07:45:49.747Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 duration_ms=62ns method=POST pid=986 status=200 url="http://unix/api/v4/internal/pre_receive"1653gitlab # [ 411.297875] gitaly[986]: time="2026-09-04T07:45:49.748Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:48.714" grpc.time_ms=1034.029 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1654gitlab # [ 411.334817] gitaly[986]: time="2026-09-04T07:45:49.794Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:49.793" grpc.time_ms=1.274 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1655gitlab # [ 411.390259] gitaly[986]: time="2026-09-04T07:45:49.850Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:49.849" grpc.time_ms=0.827 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1656gitlab # [ 411.471065] gitaly[986]: time="2026-09-04T07:45:49.930Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:49.929" grpc.time_ms=0.89 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1657gitlab # [ 411.677476] gitaly[986]: time="2026-09-04T07:45:50.136Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:46:00.063" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:50.114" grpc.time_ms=22.158 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 411.749931] gitaly[986]: time="2026-09-04T07:45:50.209Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=36 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=45 command.spawn_token_fork_ms=12 command.system_time_ms=36 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:46:00.106" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:45:50.158" grpc.time_ms=51.229 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 411.793784] gitaly[986]: time="2026-09-04T07:45:50.253Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 duration_ms=272ns method=POST pid=986 status=200 url="http://unix/api/v4/internal/post_receive"1660gitlab # [ 411.800455] gitaly[986]: time="2026-09-04T07:45:50.255Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:49.979" grpc.time_ms=275.656 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1661gitlab # [ 411.823329] gitaly[986]: time="2026-09-04T07:45:50.272Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 diskcache=a4c136ec-d40a-45dd-8407-633aef6632b2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:48.588" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1662gitlab # [ 411.842933] setup-gitlab-start[4023]: To http://gitlab/root/test-flake.git1663gitlab # [ 411.844613] setup-gitlab-start[4023]: * [new branch] master -> master1664gitlab # [ 411.846304] setup-gitlab-start[4023]: branch 'master' set up to track 'origin/master'.1665gitlab # [ 411.848845] gitlab-workhorse[871]: time="2026-09-04T07:45:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521666gitlab # [ 411.852268] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:50 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 18211667gitlab # [ 411.856071] systemd[1]: Finished setup-gitlab.service.1668gitlab # [ 411.857405] gitaly[986]: time="2026-09-04T07:45:50.272Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=345 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13464 command.oublock=32 command.real_time_ms=1671 command.spawn_token_fork_ms=2 command.system_time_ms=223 command.user_time_ms=122 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:48.588" grpc.time_ms=1684.555 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1669gitlab # [ 411.879859] systemd[1]: Starting nixbot CI service...1670gitlab: (finished: waiting for unit setup-gitlab.service, in 413.52 seconds)1671gitlab: waiting for unit nixbot.service1672gitlab # [ 413.344449] nixbot[4118]: {"ts": "2026-09-04T07:45:51.803Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1673gitlab # [ 413.370360] nixbot[4118]: {"ts": "2026-09-04T07:45:51.829Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1674gitlab # [ 413.414258] nixbot[4118]: {"ts": "2026-09-04T07:45:51.873Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1675gitlab # [ 413.423046] nixbot[4118]: {"ts": "2026-09-04T07:45:51.882Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1676gitlab # [ 413.431186] nixbot[4118]: {"ts": "2026-09-04T07:45:51.890Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1677gitlab # [ 413.443745] nixbot[4118]: {"ts": "2026-09-04T07:45:51.903Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1678gitlab # [ 413.451287] nixbot[4118]: {"ts": "2026-09-04T07:45:51.911Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1679gitlab # [ 413.455839] nixbot[4118]: {"ts": "2026-09-04T07:45:51.914Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1680gitlab # [ 413.467405] nixbot[4118]: {"ts": "2026-09-04T07:45:51.927Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1681gitlab # [ 413.472633] nixbot[4118]: {"ts": "2026-09-04T07:45:51.930Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1682gitlab # [ 413.480132] nixbot[4118]: {"ts": "2026-09-04T07:45:51.939Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1683gitlab # [ 413.491329] nixbot[4118]: {"ts": "2026-09-04T07:45:51.950Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1684gitlab # [ 413.497070] nixbot[4118]: {"ts": "2026-09-04T07:45:51.955Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1685gitlab # [ 413.502239] nixbot[4118]: {"ts": "2026-09-04T07:45:51.959Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1686gitlab # [ 413.507588] nixbot[4118]: {"ts": "2026-09-04T07:45:51.965Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1687gitlab # [ 413.512942] nixbot[4118]: {"ts": "2026-09-04T07:45:51.968Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1688gitlab # [ 413.517811] nixbot[4118]: {"ts": "2026-09-04T07:45:51.971Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1689gitlab # [ 413.523775] nixbot[4118]: {"ts": "2026-09-04T07:45:51.973Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1690gitlab # [ 413.528550] nixbot[4118]: {"ts": "2026-09-04T07:45:51.981Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1691gitlab # [ 413.533016] nixbot[4118]: {"ts": "2026-09-04T07:45:51.984Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1692gitlab # [ 413.537535] nixbot[4118]: {"ts": "2026-09-04T07:45:51.987Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1693gitlab # [ 413.541966] nixbot[4118]: {"ts": "2026-09-04T07:45:51.996Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1694gitlab # [ 413.546430] nixbot[4118]: {"ts": "2026-09-04T07:45:51.998Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1695gitlab # [ 413.550905] nixbot[4118]: {"ts": "2026-09-04T07:45:52.001Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1696gitlab # [ 413.555233] nixbot[4118]: {"ts": "2026-09-04T07:45:52.005Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1697gitlab # [ 413.559420] nixbot[4118]: {"ts": "2026-09-04T07:45:52.010Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1698gitlab # [ 413.563547] nixbot[4118]: {"ts": "2026-09-04T07:45:52.013Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1699gitlab # [ 413.567425] nixbot[4118]: {"ts": "2026-09-04T07:45:52.015Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1700gitlab # [ 413.570969] nixbot[4118]: {"ts": "2026-09-04T07:45:52.017Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1701gitlab # [ 413.582695] nixbot[4118]: {"ts": "2026-09-04T07:45:52.042Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1702gitlab # [ 413.586712] nixbot[4118]: {"ts": "2026-09-04T07:45:52.046Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1703gitlab # [ 413.962157] nixbot[4118]: INFO: Started server process [4118]1704gitlab # [ 413.965507] nixbot[4118]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1705gitlab # [ 413.992349] nixbot[4118]: INFO: ::ffff:127.0.0.1:51602 - "GET /health HTTP/1.1" 200 OK1706gitlab # [ 414.003120] systemd[1]: Started nixbot CI service.1707gitlab # [ 414.006286] systemd[1]: Reached target Multi-User System.1708gitlab # [ 414.008407] systemd[1]: Startup finished in 1.146s (kernel) + 5.587s (initrd) + 6min 47.274s (userspace) = 6min 54.008s.1709gitlab: (finished: waiting for unit nixbot.service, in 1.08 seconds)1710gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1711gitlab # [ 414.078164] nixbot[4118]: INFO: ::ffff:127.0.0.1:51612 - "GET /health HTTP/1.1" 200 OK1712gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1713subtest: project discovered and webhook registered1714gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1715gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.25 seconds)1716gitlab # [ 414.327501] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1971717gitlab # [ 414.412274] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:52 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4161718gitlab # [ 414.425562] nixbot[4118]: {"ts": "2026-09-04T07:45:52.870Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1719gitlab # [ 414.472146] nixbot[4118]: {"ts": "2026-09-04T07:45:52.931Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1720gitlab # [ 414.606632] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1101721gitlab # [ 414.613269] nixbot[4118]: {"ts": "2026-09-04T07:45:53.068Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1722gitlab # [ 414.620448] nixbot[4118]: {"ts": "2026-09-04T07:45:53.072Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1723gitlab # [ 414.784933] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1661724gitlab # [ 414.791527] nixbot[4118]: {"ts": "2026-09-04T07:45:53.246Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1725gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1726gitlab # [ 415.503819] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 1111727gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1728(finished: subtest: project discovered and webhook registered, in 1.43 seconds)1729subtest: push delivers the webhook1730gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1731gitlab # [ 415.634369] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 471732gitlab # [ 415.760441] gitaly[986]: time="2026-09-04T07:45:54.218Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP36XN0H0QBX3ED6G7NK0T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:54.202" grpc.time_ms=15.37 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1733gitlab # [ 415.804104] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 1611734gitlab # Enumerating objects: 5, done.1735gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1736gitlab # Delta compression using up to 4 threads1737gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1738gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 91.00 KiB/s, done.1739gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1740gitlab # [ 416.073325] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:54 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 12731741gitlab # [ 416.083009] nixbot[4118]: {"ts": "2026-09-04T07:45:54.535Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1742gitlab # [ 416.209237] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1171743gitlab # [ 416.215901] nixbot[4118]: {"ts": "2026-09-04T07:45:54.671Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1744gitlab # [ 416.261137] gitaly[986]: time="2026-09-04T07:45:54.720Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:46:24.098" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:45:54.699" grpc.time_ms=21.079 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745gitlab # [ 416.335937] gitaly[986]: time="2026-09-04T07:45:54.794Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC duration_ms=233ns method=POST pid=986 status=200 url="http://unix/api/v4/internal/allowed"1746gitlab # [ 416.344999] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:54 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 1231747gitlab # [ 416.351513] nixbot[4118]: {"ts": "2026-09-04T07:45:54.800Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1748gitlab # [ 416.403714] gitaly[986]: time="2026-09-04T07:45:54.862Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC duration_ms=67ns method=POST pid=986 status=200 url="http://unix/api/v4/internal/pre_receive"1749gitlab # [ 416.420162] gitaly[986]: time="2026-09-04T07:45:54.863Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:54.559" grpc.time_ms=303.339 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1750gitlab # [ 416.438523] gitaly[986]: time="2026-09-04T07:45:54.898Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP37KPJB50MR2BVR5Z0WWT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T07:46:24.377" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:45:54.878" grpc.time_ms=19.538 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751gitlab # [ 416.469698] gitaly[986]: time="2026-09-04T07:45:54.928Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:54.925" grpc.time_ms=2.874 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1752gitlab # [ 416.480640] gitaly[986]: time="2026-09-04T07:45:54.933Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP37KPJB50MR2BVR5Z0WWT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:24.432" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:45:54.932" grpc.time_ms=0.569 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1753gitlab # [ 416.502159] gitaly[986]: time="2026-09-04T07:45:54.962Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=11 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP37KPJB50MR2BVR5Z0WWT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T07:46:04.002" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:45:54.943" grpc.time_ms=18.757 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1754gitlab # [ 416.515897] gitaly[986]: time="2026-09-04T07:45:54.974Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:54.974" grpc.time_ms=0.493 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1755gitlab # [ 416.548254] gitaly[986]: time="2026-09-04T07:45:55.005Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:55.004" grpc.time_ms=1.167 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1756gitlab # [ 416.559366] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2041757gitlab # [ 416.561786] nixbot[4118]: {"ts": "2026-09-04T07:45:55.012Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1758gitlab # [ 416.635294] gitaly[986]: time="2026-09-04T07:45:55.095Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC duration_ms=61ns method=POST pid=986 status=200 url="http://unix/api/v4/internal/post_receive"1759gitlab # [ 416.638532] gitaly[986]: time="2026-09-04T07:45:55.096Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:55.032" grpc.time_ms=63.752 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1760gitlab # [ 416.649593] gitaly[986]: time="2026-09-04T07:45:55.109Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC diskcache=3c3098ba-8725-4758-89bd-9452c65f6dda grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:54.445" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1761gitlab # To http://gitlab/root/test-flake.git1762gitlab # [ 416.659582] gitaly[986]: time="2026-09-04T07:45:55.110Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=247 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13238 command.oublock=32 command.real_time_ms=655 command.spawn_token_fork_ms=7 command.system_time_ms=137 command.user_time_ms=110 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:54.445" grpc.time_ms=664.253 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1763gitlab # 7b346bd..6aa9b76 [ 416.674849] nixbot[4118]: {"ts": "2026-09-04T07:45:55.112Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1764gitlab # master -> master[ 416.677675] nixbot[4118]: {"ts": "2026-09-04T07:45:55.116Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1765gitlab # 1766gitlab # [ 416.680124] gitlab-workhorse[871]: time="2026-09-04T07:45:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521767gitlab # [ 416.682113] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:55 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 8051768gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.18 seconds)1769gitlab # [ 416.684149] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 931770gitlab: must succeed: git -C /tmp/test-flake rev-parse master1771gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1772gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1773gitlab # [ 416.812001] nixbot[4118]: INFO: ::ffff:127.0.0.1:51624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1774gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.11 seconds)1775gitlab # [ 416.958463] gitaly[986]: time="2026-09-04T07:45:55.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP37YT6X843FVCZ7FG0F0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.397" grpc.time_ms=19.584 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1776gitlab # [ 416.972162] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:55 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 2571777gitlab # [ 417.210662] gitaly[986]: time="2026-09-04T07:45:55.670Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP386ZM3Y25A6SAXQPKX0Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.649" pid=986 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1778gitlab # [ 417.230335] gitaly[986]: time="2026-09-04T07:45:55.670Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP386ZM3Y25A6SAXQPKX0Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.649" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1779gitlab # [ 417.252121] gitlab-workhorse[871]: time="2026-09-04T07:45:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131780gitlab # [ 417.254985] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2501781gitlab # [ 417.258024] gitaly[986]: time="2026-09-04T07:45:55.671Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP386ZM3Y25A6SAXQPKX0Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.649" grpc.time_ms=21.675 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1782gitlab # [ 417.391278] gitaly[986]: time="2026-09-04T07:45:55.851Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP38F08A541T94VA6GZ90T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.816" pid=986 remote_ip="2001:db8:1::1" request_sha=39722213a7aa942ae0537e3462b6c211d2ad1e31 response_bytes=419 span.kind=server system=grpc1783gitlab # [ 417.413291] gitaly[986]: time="2026-09-04T07:45:55.851Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP38F08A541T94VA6GZ90T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.816" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1784gitlab # [ 417.437985] gitlab-workhorse[871]: time="2026-09-04T07:45:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4191785gitlab # [ 417.441088] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 419 "" "git/2.55.0" 1721786gitlab # [ 417.444086] gitaly[986]: time="2026-09-04T07:45:55.851Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP38F08A541T94VA6GZ90T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.816" grpc.time_ms=35.192 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1787gitlab # [ 417.554095] gitaly[986]: time="2026-09-04T07:45:56.013Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP38PP4FZENEBZFR60G2QP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:55.996" grpc.time_ms=16.705 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1788gitlab # [ 417.572220] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 891789gitlab # [ 417.701719] gitaly[986]: time="2026-09-04T07:45:56.161Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP38SK5AJFEVS7V3D717BH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:56.141" pid=986 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1790gitlab # [ 417.731870] gitaly[986]: time="2026-09-04T07:45:56.161Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP38SK5AJFEVS7V3D717BH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:56.141" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1791gitlab # [ 417.760325] gitlab-workhorse[871]: time="2026-09-04T07:45:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671792gitlab # [ 417.763929] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1431793gitlab # [ 417.767618] gitaly[986]: time="2026-09-04T07:45:56.162Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP38SK5AJFEVS7V3D717BH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:56.141" grpc.time_ms=20.402 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1794gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1795gitlab # [ 417.866471] nixbot[4118]: INFO: ::ffff:127.0.0.1:51638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1796gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1797gitlab # [ 417.900221] gitaly[986]: time="2026-09-04T07:45:56.360Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP390BQJ7F62WJ8FZN3PBW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:56.342" grpc.time_ms=17.528 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1798gitlab # [ 417.923709] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:56 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1241799gitlab # [ 418.001029] gitaly[986]: time="2026-09-04T07:45:56.460Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP394AK3Q9PE2JZS7KS6Y6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:56.432" pid=986 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1800gitlab # [ 418.015083] gitaly[986]: time="2026-09-04T07:45:56.460Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP394AK3Q9PE2JZS7KS6Y6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:56.432" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1801gitlab # [ 418.031369] gitaly[986]: time="2026-09-04T07:45:56.474Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP394AK3Q9PE2JZS7KS6Y6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:45:56.432" grpc.time_ms=41.761 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1802gitlab # [ 418.049327] gitlab-workhorse[871]: time="2026-09-04T07:45:56Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091803gitlab # [ 418.051318] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:56 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1131804gitlab # [ 418.165640] gitaly[986]: time="2026-09-04T07:45:56.625Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:26.122" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:45:56.623" grpc.time_ms=1.452 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1805gitlab # [ 418.256881] gitaly[986]: time="2026-09-04T07:45:56.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:46:26.197" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:45:56.698" grpc.time_ms=18.373 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1806gitlab # [ 418.310508] gitaly[986]: time="2026-09-04T07:45:56.770Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:06.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:45:56.753" grpc.time_ms=16.504 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 418.344670] gitaly[986]: time="2026-09-04T07:45:56.804Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:06.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:45:56.788" grpc.time_ms=15.803 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 418.496148] gitaly[986]: time="2026-09-04T07:45:56.955Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:46:06.013" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:56.954" grpc.time_ms=0.711 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 418.527841] gitaly[986]: time="2026-09-04T07:45:56.985Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:46:06.029" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:45:56.970" grpc.time_ms=14.657 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 418.593496] gitaly[986]: time="2026-09-04T07:45:57.053Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:57.052" grpc.time_ms=0.936 pid=986 span.kind=server system=grpc1811gitlab # [ 418.648967] gitaly[986]: time="2026-09-04T07:45:57.108Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:45:57.107" grpc.time_ms=0.929 pid=986 span.kind=server system=grpc1812gitlab # [ 418.677938] gitaly[986]: time="2026-09-04T07:45:57.120Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J diskcache=6745a8c1-1d38-461d-af46-7b06df702a4c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:46:06.049" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:56.990" pid=986 ref=refs/keep-around/7b346bdb097f04a1fa3fb25bcd9759283fb63871 remote_ip="2001:db8:1::1" revision=7b346bdb097f04a1fa3fb25bcd9759283fb63871 span.kind=server system=grpc username=root1813gitlab # [ 418.703150] gitaly[986]: time="2026-09-04T07:45:57.121Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=122 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5268 command.oublock=8 command.real_time_ms=122 command.spawn_token_fork_ms=2 command.system_time_ms=86 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:46:06.049" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:45:56.990" grpc.time_ms=130.682 pid=986 ref=refs/keep-around/7b346bdb097f04a1fa3fb25bcd9759283fb63871 remote_ip="2001:db8:1::1" revision=7b346bdb097f04a1fa3fb25bcd9759283fb63871 span.kind=server system=grpc username=root1814gitlab # [ 418.726285] gitaly[986]: time="2026-09-04T07:45:57.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:27.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:45:57.127" grpc.time_ms=0.675 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1816gitlab # [ 418.938877] nixbot[4118]: INFO: ::ffff:127.0.0.1:51646 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1817gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.07 seconds)1818gitlab # [ 418.999714] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:45:57 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 9151819gitlab # [ 419.007913] nixbot[4118]: {"ts": "2026-09-04T07:45:57.459Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 \"HTTP/1.1 201 Created\""}1820gitlab # [ 419.016758] nixbot[4118]: {"ts": "2026-09-04T07:45:57.474Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-7b346bdb097f-0"}1821gitlab # [ 419.309587] nixbot[4118]: {"ts": "2026-09-04T07:45:57.769Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-7b346bdb097f-0", "argv0": "bwrap"}1822gitlab # [ 419.490181] systemd[1]: Started Nix Daemon.1823gitlab # [ 419.618337] nix-daemon[4349]: accepted connection from pid 4344, user nixbot1824gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1825gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1826gitlab # [ 420.006003] nixbot[4118]: INFO: ::ffff:127.0.0.1:51662 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1827gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1829gitlab # [ 421.062656] nixbot[4118]: INFO: ::ffff:127.0.0.1:39834 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1830gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1832gitlab # [ 422.120154] nixbot[4118]: INFO: ::ffff:127.0.0.1:39844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1833gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1835gitlab # [ 423.176500] nixbot[4118]: INFO: ::ffff:127.0.0.1:39852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1836gitlab # [ 424.143491] nix-daemon[4349]: accepted connection from pid 4372, user nixbot1837gitlab # [ 424.167737] nix-daemon[4349]: accepted connection from pid 4344, user nixbot1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1839gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1840gitlab # [ 424.232501] nixbot[4118]: INFO: ::ffff:127.0.0.1:39864 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1841gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1842gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1843gitlab # [ 425.290482] nixbot[4118]: INFO: ::ffff:127.0.0.1:39868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1845gitlab # [ 426.347599] nixbot[4118]: INFO: ::ffff:127.0.0.1:39882 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1846gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1848gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1849gitlab # [ 427.407724] nixbot[4118]: INFO: ::ffff:127.0.0.1:39884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1850gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1851gitlab # [ 428.463871] nixbot[4118]: INFO: ::ffff:127.0.0.1:39888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1852gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1853gitlab # [ 428.869913] nix-daemon[4349]: accepted connection from pid 4344, user nixbot1854gitlab # [ 429.095869] gitaly[986]: time="2026-09-04T07:46:07.554Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3KXZMZ8PW0409A8E9M63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:37.052" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:07.553" grpc.time_ms=1.212 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 429.324773] gitaly[986]: time="2026-09-04T07:46:07.784Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3KXZMZ8PW0409A8E9M63 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:17.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:07.764" grpc.time_ms=19.791 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1857gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.07 seconds)1858gitlab # [ 429.536651] nixbot[4118]: INFO: ::ffff:127.0.0.1:39896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1859gitlab # [ 429.556712] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 5911860gitlab # [ 429.569010] nixbot[4118]: {"ts": "2026-09-04T07:46:08.016Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 \"HTTP/1.1 201 Created\""}1861gitlab # [ 429.647456] gitaly[986]: time="2026-09-04T07:46:08.107Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3MGRHQEMK6M857CSGX8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:38.005" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:08.105" grpc.time_ms=1.162 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 429.722286] gitaly[986]: time="2026-09-04T07:46:08.182Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3MGRHQEMK6M857CSGX8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:18.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:08.163" grpc.time_ms=17.926 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 429.800465] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2341864gitlab # [ 429.808511] nixbot[4118]: {"ts": "2026-09-04T07:46:08.261Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 \"HTTP/1.1 201 Created\""}1865gitlab # [ 429.906863] gitaly[986]: time="2026-09-04T07:46:08.366Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3MRN3EK1JPJ45NXYPXTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:46:38.064" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:46:08.364" grpc.time_ms=1.248 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 429.989427] gitaly[986]: time="2026-09-04T07:46:08.449Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3MRN3EK1JPJ45NXYPXTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:46:18.079" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:46:08.429" grpc.time_ms=18.717 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab # [ 430.110508] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2921868gitlab # [ 430.116092] nixbot[4118]: {"ts": "2026-09-04T07:46:08.572Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 \"HTTP/1.1 201 Created\""}1869gitlab # [ 430.444561] gitaly[986]: time="2026-09-04T07:46:08.903Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3N99J5KVJC4PE7TX0JB3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:08.886" grpc.time_ms=16.133 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1870gitlab # [ 430.484075] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 941871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1872gitlab # [ 430.540003] gitaly[986]: time="2026-09-04T07:46:08.999Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NCAX3CG6ZH3DA7AR5A7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:08.978" pid=986 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1873gitlab # [ 430.552591] gitaly[986]: time="2026-09-04T07:46:09.000Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NCAX3CG6ZH3DA7AR5A7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:08.978" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1874gitlab # [ 430.568486] gitlab-workhorse[871]: time="2026-09-04T07:46:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671875gitlab # [ 430.570588] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 951876gitlab # [ 430.572687] gitaly[986]: time="2026-09-04T07:46:09.000Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NCAX3CG6ZH3DA7AR5A7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:08.978" grpc.time_ms=21.645 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1877gitlab # [ 430.597642] nixbot[4118]: INFO: ::ffff:127.0.0.1:39910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1879gitlab # [ 430.689301] gitaly[986]: time="2026-09-04T07:46:09.149Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3NHR29EKHSR1CAKH1J4D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.139" grpc.time_ms=9.271 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1880gitlab # [ 430.704585] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 681881gitlab # [ 430.793867] gitaly[986]: time="2026-09-04T07:46:09.253Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NM0HBDN7ZWBDRSB3GFT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.233" pid=986 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1882gitlab # [ 430.804377] gitaly[986]: time="2026-09-04T07:46:09.253Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NM0HBDN7ZWBDRSB3GFT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.233" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1883gitlab # [ 430.817808] gitlab-workhorse[871]: time="2026-09-04T07:46:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671884gitlab # [ 430.819788] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1021885gitlab # [ 430.821880] gitaly[986]: time="2026-09-04T07:46:09.254Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NM0HBDN7ZWBDRSB3GFT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.233" grpc.time_ms=20.699 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1886gitlab # [ 430.981822] gitaly[986]: time="2026-09-04T07:46:09.440Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3NT0F3REJFBNPMWZCQDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.420" grpc.time_ms=20.358 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 431.003278] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 961888gitlab # [ 431.143269] gitaly[986]: time="2026-09-04T07:46:09.602Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NX5GKRHNKRQP50J4R5R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.565" pid=986 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1889gitlab # [ 431.174094] gitaly[986]: time="2026-09-04T07:46:09.602Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=2 command.system_time_ms=31 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NX5GKRHNKRQP50J4R5R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.565" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1890gitlab # [ 431.207106] gitlab-workhorse[871]: time="2026-09-04T07:46:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161891gitlab # [ 431.211829] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:46:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1881892gitlab # [ 431.216498] gitaly[986]: time="2026-09-04T07:46:09.603Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=2 command.system_time_ms=31 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3NX5GKRHNKRQP50J4R5R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:46:09.565" grpc.time_ms=37.318 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc1893gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1894gitlab # [ 431.663405] nixbot[4118]: INFO: ::ffff:127.0.0.1:51116 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1895gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1896gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1897gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)1898gitlab # [ 432.721725] nixbot[4118]: INFO: ::ffff:127.0.0.1:51118 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1899gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1900gitlab # [ 433.776314] nixbot[4118]: INFO: ::ffff:127.0.0.1:51128 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1901gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1902gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1903gitlab # [ 434.835814] nixbot[4118]: INFO: ::ffff:127.0.0.1:51134 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1904gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1905gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1906gitlab # [ 435.894793] nixbot[4118]: INFO: ::ffff:127.0.0.1:51150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1907gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1908gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1909gitlab # [ 436.954184] nixbot[4118]: INFO: ::ffff:127.0.0.1:51154 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1910gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1911gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1912gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1913gitlab # [ 438.012293] nixbot[4118]: INFO: ::ffff:127.0.0.1:51166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1914gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1915gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1916gitlab # [ 439.067971] nixbot[4118]: INFO: ::ffff:127.0.0.1:51180 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1917gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1918gitlab # [ 440.124173] nixbot[4118]: INFO: ::ffff:127.0.0.1:51188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1919gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1920gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1921gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1922gitlab # [ 441.182457] nixbot[4118]: INFO: ::ffff:127.0.0.1:39402 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1923gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1924gitlab # [ 442.235960] nixbot[4118]: INFO: ::ffff:127.0.0.1:39414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1925gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1926gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1927gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1928gitlab # [ 443.297717] nixbot[4118]: INFO: ::ffff:127.0.0.1:39430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1929gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1930gitlab # [ 444.357587] nixbot[4118]: INFO: ::ffff:127.0.0.1:39440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1931gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1932gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1933gitlab # [ 445.425875] nixbot[4118]: INFO: ::ffff:127.0.0.1:39442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1934gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.07 seconds)1935gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1936gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1937gitlab # [ 446.490735] nixbot[4118]: INFO: ::ffff:127.0.0.1:39456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1938gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1939gitlab # [ 447.541137] nixbot[4118]: INFO: ::ffff:127.0.0.1:39460 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1940gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)1941gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1942gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1943gitlab # [ 448.604701] nixbot[4118]: INFO: ::ffff:127.0.0.1:39464 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1944gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1945gitlab # [ 449.695549] nixbot[4118]: INFO: ::ffff:127.0.0.1:39474 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1946gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.10 seconds)1947gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1948gitlab # [ 450.790058] nixbot[4118]: INFO: ::ffff:127.0.0.1:39486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1949gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.09 seconds)1950gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1951gitlab # [ 451.871763] nixbot[4118]: INFO: ::ffff:127.0.0.1:43840 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1952gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.08 seconds)1953gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1954gitlab # [ 452.954232] nixbot[4118]: INFO: ::ffff:127.0.0.1:43842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1955gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.08 seconds)1956gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1957gitlab # [ 454.043736] nixbot[4118]: INFO: ::ffff:127.0.0.1:43858 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1958gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.09 seconds)1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1960gitlab # [ 455.128697] nixbot[4118]: INFO: ::ffff:127.0.0.1:43868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.08 seconds)1962gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1963gitlab # [ 456.210549] nixbot[4118]: INFO: ::ffff:127.0.0.1:43880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.08 seconds)1965gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1966gitlab # [ 457.268153] nixbot[4118]: INFO: ::ffff:127.0.0.1:43892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1967gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1968gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1969gitlab # [ 458.326334] nixbot[4118]: INFO: ::ffff:127.0.0.1:43902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1970gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1971gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1972gitlab # [ 459.383848] nixbot[4118]: INFO: ::ffff:127.0.0.1:43914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1973gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1974gitlab # [ 459.411964] sidekiq-cluster[4052]: 2026-09-04T07:46:37.870Z pid=4052 tid=y9o INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>4052, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432668672}1975gitlab # [ 459.744483] sidekiq-cluster[4052]: W, [2026-09-04T07:46:38.204102 #4052] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1976gitlab # [ 459.817196] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:46:38.276Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1977gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1978gitlab # [ 460.441466] nixbot[4118]: INFO: ::ffff:127.0.0.1:43922 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1979gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1980gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1981gitlab # [ 461.499211] nixbot[4118]: INFO: ::ffff:127.0.0.1:58844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1982gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1983gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1984gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1985gitlab # [ 462.558983] nixbot[4118]: INFO: ::ffff:127.0.0.1:58852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1986gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1987gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1988gitlab # [ 463.617036] nixbot[4118]: INFO: ::ffff:127.0.0.1:58866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1989gitlab # [ 463.767637] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:46:42.226Z","message":"GitLab reliable fetch activated!"}1990gitlab # [ 463.772738] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:46:42.226Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1992gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)1993gitlab # [ 464.674333] nixbot[4118]: INFO: ::ffff:127.0.0.1:58870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1994gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1995gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)1996gitlab # [ 465.730736] nixbot[4118]: INFO: ::ffff:127.0.0.1:58880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK1997gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)1999gitlab # [ 466.785947] nixbot[4118]: INFO: ::ffff:127.0.0.1:58892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2001gitlab # [ 467.841207] nixbot[4118]: INFO: ::ffff:127.0.0.1:58900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2002gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2003gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2004gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2005gitlab # [ 468.898245] nixbot[4118]: INFO: ::ffff:127.0.0.1:58916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2006gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2007gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2008gitlab # [ 469.951393] nixbot[4118]: INFO: ::ffff:127.0.0.1:58932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2009gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2011gitlab # [ 471.006015] nixbot[4118]: INFO: ::ffff:127.0.0.1:53930 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2012gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2013gitlab # [ 472.059363] nixbot[4118]: INFO: ::ffff:127.0.0.1:53938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2014gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2015gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2016gitlab # [ 473.116834] nixbot[4118]: INFO: ::ffff:127.0.0.1:53946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2017gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2018gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2019gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2020gitlab # [ 474.173778] nixbot[4118]: INFO: ::ffff:127.0.0.1:53948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2022gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2023gitlab # [ 475.228771] nixbot[4118]: INFO: ::ffff:127.0.0.1:53962 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2024gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2025gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2026gitlab # [ 476.284108] nixbot[4118]: INFO: ::ffff:127.0.0.1:53978 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2027gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2028gitlab # [ 477.340629] nixbot[4118]: INFO: ::ffff:127.0.0.1:53982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2029gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2030gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2031gitlab # [ 478.398364] nixbot[4118]: INFO: ::ffff:127.0.0.1:53990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2032gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2034gitlab # [ 479.457183] nixbot[4118]: INFO: ::ffff:127.0.0.1:53998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2037gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2038gitlab # [ 480.516338] nixbot[4118]: INFO: ::ffff:127.0.0.1:54000 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2039gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2040gitlab # [ 481.571565] nixbot[4118]: INFO: ::ffff:127.0.0.1:52144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2041gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2042gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2043gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2044gitlab # [ 482.629829] nixbot[4118]: INFO: ::ffff:127.0.0.1:52150 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2045gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2046gitlab # [ 483.686355] nixbot[4118]: INFO: ::ffff:127.0.0.1:52160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2047gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2048gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2049gitlab # [ 484.749638] nixbot[4118]: INFO: ::ffff:127.0.0.1:52166 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2051gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2052gitlab # [ 485.807777] nixbot[4118]: INFO: ::ffff:127.0.0.1:52172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2053gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2054gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2055gitlab # [ 486.864371] nixbot[4118]: INFO: ::ffff:127.0.0.1:52188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2056gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2057gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2058gitlab # [ 487.921909] nixbot[4118]: INFO: ::ffff:127.0.0.1:52192 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2059gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2060gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2061gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2062gitlab # [ 488.980314] nixbot[4118]: INFO: ::ffff:127.0.0.1:52194 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2063gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2064gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2065gitlab # [ 490.038303] nixbot[4118]: INFO: ::ffff:127.0.0.1:52204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2066gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2067gitlab # [ 491.094723] nixbot[4118]: INFO: ::ffff:127.0.0.1:43502 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2068gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2069gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2070gitlab # [ 492.153508] nixbot[4118]: INFO: ::ffff:127.0.0.1:43514 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2071gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2072gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2073gitlab # [ 493.210885] nixbot[4118]: INFO: ::ffff:127.0.0.1:43516 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2074gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2075gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2076gitlab # [ 494.269528] nixbot[4118]: INFO: ::ffff:127.0.0.1:43520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2077gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2078gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2079gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2080gitlab # [ 495.327279] nixbot[4118]: INFO: ::ffff:127.0.0.1:43528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2081gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2082gitlab # [ 496.383658] nixbot[4118]: INFO: ::ffff:127.0.0.1:43544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2083gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2084gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2085gitlab # [ 497.443929] nixbot[4118]: INFO: ::ffff:127.0.0.1:43550 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2086gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2087gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2089gitlab # [ 498.503425] nixbot[4118]: INFO: ::ffff:127.0.0.1:43554 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2090gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2091gitlab # [ 499.559380] nixbot[4118]: INFO: ::ffff:127.0.0.1:43560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2092gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2093gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2094gitlab # [ 500.617572] nixbot[4118]: INFO: ::ffff:127.0.0.1:43572 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2095gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2096gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2097gitlab # [ 501.673714] nixbot[4118]: INFO: ::ffff:127.0.0.1:60644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2098gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2099gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2100gitlab # [ 502.733092] nixbot[4118]: INFO: ::ffff:127.0.0.1:60660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2101gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2102gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2103gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2104gitlab # [ 503.790993] nixbot[4118]: INFO: ::ffff:127.0.0.1:60664 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2105gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2106gitlab # [ 504.847449] nixbot[4118]: INFO: ::ffff:127.0.0.1:60678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2107gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2108gitlab # [ 505.442000] postgres[4714]: [4714] ERROR: relation "table_without_models" does not exist2109gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2110gitlab # [ 505.444505] postgres[4714]: [4714] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2111gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2112gitlab # [ 505.907762] nixbot[4118]: INFO: ::ffff:127.0.0.1:60680 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2113gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2114gitlab # [ 506.970299] nixbot[4118]: INFO: ::ffff:127.0.0.1:60682 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2115gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2116gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2117gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.05 seconds)2118gitlab # [ 508.021505] nixbot[4118]: INFO: ::ffff:127.0.0.1:60690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2119gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2120gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2121gitlab # [ 509.077216] nixbot[4118]: INFO: ::ffff:127.0.0.1:60694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2122gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2123gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2124gitlab # [ 510.133172] nixbot[4118]: INFO: ::ffff:127.0.0.1:60698 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2125gitlab # [ 510.607068] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:29.066Z","message":"Booted Rails 7.2.3.1 application in production environment"}2126gitlab # [ 510.609253] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:29.068Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2127gitlab # [ 510.611192] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:29.069Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2128gitlab # [ 510.612962] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:29.069Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2129gitlab # [ 510.614882] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:29.072Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2130gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2131gitlab # [ 511.190527] nixbot[4118]: INFO: ::ffff:127.0.0.1:48872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2132gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2133gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2134gitlab # [ 512.274288] nixbot[4118]: INFO: ::ffff:127.0.0.1:48888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2135gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.08 seconds)2136gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2137gitlab # [ 513.331785] nixbot[4118]: INFO: ::ffff:127.0.0.1:48898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2138gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2139gitlab # [ 513.433176] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:31.891Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8ec076ee856f3f70ead627eb","created_at":"2026-09-04T07:45:43.963Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:44.021Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8ec076ee856f3f70ead627eb: start","job_status":"start","queue_duration_s":107.869213,"scheduling_latency_s":107.869313}2140gitlab # [ 513.805985] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.264Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"8ec076ee856f3f70ead627eb","created_at":"2026-09-04T07:45:43.963Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:44.021Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-8ec076ee856f3f70ead627eb: done: 0.374041 sec","job_status":"done","queue_duration_s":107.869213,"scheduling_latency_s":107.869313,"redis_calls":23,"redis_duration_s":0.010832,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.00582,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002979,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.189186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18826022,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.374041,"completed_at":"2026-09-04T07:47:32.264Z","load_balancing_strategy":"primary","db_duration_s":0.10556,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2141gitlab # [ 513.904678] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.268Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"1037e7910139141257df958c","created_at":"2026-09-04T07:45:44.039Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:44.049Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-1037e7910139141257df958c: start","job_status":"start","queue_duration_s":108.21841,"scheduling_latency_s":108.218456}2142gitlab # [ 513.986452] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.445Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"1037e7910139141257df958c","created_at":"2026-09-04T07:45:44.039Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:44.049Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-1037e7910139141257df958c: done: 0.177589 sec","job_status":"done","queue_duration_s":108.21841,"scheduling_latency_s":108.218456,"redis_calls":14,"redis_duration_s":0.004818,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000927,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00244,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001451,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.129797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13599818,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.177589,"completed_at":"2026-09-04T07:47:32.445Z","load_balancing_strategy":"primary","db_duration_s":0.036849,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2143gitlab # [ 514.081246] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.448Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0e139d1f85b23b4f5d01fbd2","created_at":"2026-09-04T07:45:45.207Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:45.216Z","job_size_bytes":5,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0e139d1f85b23b4f5d01fbd2: start","job_status":"start","queue_duration_s":107.231992,"scheduling_latency_s":107.232023}2144gitlab # [ 514.212929] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.672Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"0e139d1f85b23b4f5d01fbd2","created_at":"2026-09-04T07:45:45.207Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:45.216Z","job_size_bytes":5,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-0e139d1f85b23b4f5d01fbd2: done: 0.224173 sec","job_status":"done","queue_duration_s":107.231992,"scheduling_latency_s":107.232023,"redis_calls":12,"redis_duration_s":0.0035110000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000844,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002144,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036618,"duration_s":0.224173,"completed_at":"2026-09-04T07:47:32.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044332,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2145gitlab # [ 514.308656] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.674Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"fd0ab61589177a58cd36ec5f","created_at":"2026-09-04T07:45:45.255Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:45.262Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-fd0ab61589177a58cd36ec5f: start","job_status":"start","queue_duration_s":107.411525,"scheduling_latency_s":107.411549}2146gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2147gitlab # [ 514.394052] nixbot[4118]: INFO: ::ffff:127.0.0.1:48902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2148gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2149gitlab # [ 514.494340] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.952Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"fd0ab61589177a58cd36ec5f","created_at":"2026-09-04T07:45:45.255Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:45.262Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-fd0ab61589177a58cd36ec5f: done: 0.278546 sec","job_status":"done","queue_duration_s":107.411525,"scheduling_latency_s":107.411549,"redis_calls":11,"redis_duration_s":0.0031579999999999998,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000824,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.234,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.234,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.16879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054274,"duration_s":0.278546,"completed_at":"2026-09-04T07:47:32.952Z","load_balancing_strategy":"primary","db_duration_s":0.11241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2150gitlab # [ 514.588973] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:32.954Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"da062122b5bf4795854bf1b5","created_at":"2026-09-04T07:45:45.266Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:45.273Z","job_size_bytes":89,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-da062122b5bf4795854bf1b5: start","job_status":"start","queue_duration_s":107.681144,"scheduling_latency_s":107.681172}2151gitlab # [ 514.615288] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:33.003Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"da062122b5bf4795854bf1b5","created_at":"2026-09-04T07:45:45.266Z","trace_propagation_headers":{"sentry-trace":"fb66d126c27245cea763099755dd1a0d-fd534d552c8a4a65","baggage":"sentry-trace_id=fb66d126c27245cea763099755dd1a0d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP2VBQRT1GTAZE5D6Y2C26","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:45.273Z","job_size_bytes":89,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-da062122b5bf4795854bf1b5: done: 0.048835 sec","job_status":"done","queue_duration_s":107.681144,"scheduling_latency_s":107.681172,"redis_calls":11,"redis_duration_s":0.003027,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000793,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051224,"duration_s":0.048835,"completed_at":"2026-09-04T07:47:33.003Z","load_balancing_strategy":"primary","db_duration_s":0.009319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2152gitlab # [ 514.672347] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:33.005Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 7b346bdb097f04a1fa3fb25bcd9759283fb63871 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6444df4e9e33db01b8d1432f","created_at":"2026-09-04T07:45:50.068Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-e9d34ebea83440b6","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:50.083Z","job_size_bytes":185,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6444df4e9e33db01b8d1432f: start","job_status":"start","queue_duration_s":102.922403,"scheduling_latency_s":102.922429}2153gitlab # [ 514.689075] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:33.026Z","message":"changes: \"0000000000000000000000000000000000000000 7b346bdb097f04a1fa3fb25bcd9759283fb63871 refs/heads/master\\n\""}2154gitlab # [ 514.691727] gitaly[986]: time="2026-09-04T07:47:33.078Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:43.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:33.059" grpc.time_ms=18.933 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 514.704830] gitaly[986]: time="2026-09-04T07:47:33.099Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:43.034" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:33.085" grpc.time_ms=14.637 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 514.729006] gitaly[986]: time="2026-09-04T07:47:33.188Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:47:43.120" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:33.171" grpc.time_ms=17.589 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 514.815243] gitaly[986]: time="2026-09-04T07:47:33.275Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:33.273" grpc.time_ms=1.261 pid=986 span.kind=server system=grpc2158gitlab # [ 514.869311] gitaly[986]: time="2026-09-04T07:47:33.329Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:33.327" grpc.time_ms=1.012 pid=986 span.kind=server system=grpc2159gitlab # [ 514.894051] gitaly[986]: time="2026-09-04T07:47:33.345Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 diskcache=8ae2a591-6dc3-4c10-8a1a-869f9b0aa60a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:43.164" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:33.215" pid=986 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2160gitlab # [ 514.914416] gitaly[986]: time="2026-09-04T07:47:33.345Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=140 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5185 command.oublock=8 command.real_time_ms=122 command.spawn_token_fork_ms=0 command.system_time_ms=64 command.user_time_ms=76 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:43.164" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:33.215" grpc.time_ms=130.27 pid=986 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2161gitlab # [ 514.935368] gitaly[986]: time="2026-09-04T07:47:33.376Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:47:43.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:33.376" grpc.time_ms=0.333 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 514.951152] gitaly[986]: time="2026-09-04T07:47:33.410Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:47:43.013" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:33.383" grpc.time_ms=27.201 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 515.129593] gitaly[986]: time="2026-09-04T07:47:33.589Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-04T07:48:03.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:33.576" grpc.time_ms=12.862 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2164gitlab # [ 515.191405] gitaly[986]: time="2026-09-04T07:47:33.651Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:47:43.279" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:33.650" grpc.time_ms=0.562 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 515.222089] gitaly[986]: time="2026-09-04T07:47:33.667Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:47:43.284" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:47:33.655" grpc.time_ms=12.115 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 515.256300] gitaly[986]: time="2026-09-04T07:47:33.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:43.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:33.697" grpc.time_ms=18.264 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2167gitlab # [ 515.291194] gitaly[986]: time="2026-09-04T07:47:33.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:43.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:33.727" grpc.time_ms=16.79 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 515.339594] gitaly[986]: time="2026-09-04T07:47:33.799Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:48:03.268" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:33.769" grpc.time_ms=30.167 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.07 seconds)2171gitlab # [ 515.462767] nixbot[4118]: INFO: ::ffff:127.0.0.1:48914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2172gitlab # [ 516.053859] gitaly[986]: time="2026-09-04T07:47:34.512Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:47:44.139" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:34.510" grpc.time_ms=2.074 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab # [ 516.099217] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:34.557Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 7b346bdb097f04a1fa3fb25bcd9759283fb63871 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6444df4e9e33db01b8d1432f","created_at":"2026-09-04T07:45:50.068Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-e9d34ebea83440b6","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:50.083Z","job_size_bytes":185,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6444df4e9e33db01b8d1432f: done: 1.551676 sec","job_status":"done","queue_duration_s":102.922403,"scheduling_latency_s":102.922429,"gitaly_calls":13,"gitaly_duration_s":0.362377,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.066695,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.007235,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008529,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002562,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.0058,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.026249,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.01632,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.096,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.329,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.378,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.096,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.027768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00082578,"exclusive_lock_hold_duration_s":0.040608820000000004,"duration_s":1.551676,"completed_at":"2026-09-04T07:47:34.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.168188,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2174gitlab # [ 516.190850] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:34.560Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","7b346bdb097f04a1fa3fb25bcd9759283fb63871 6aa9b7693c850f5465f140d3cfcd1e5884232c1c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7050681612d33d6ff1647744","created_at":"2026-09-04T07:45:55.069Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-c35e2bdc9f494609","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:55.071Z","job_size_bytes":185,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7050681612d33d6ff1647744: start","job_status":"start","queue_duration_s":99.48805,"scheduling_latency_s":99.488078}2175gitlab # [ 516.208892] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:34.575Z","message":"changes: \"7b346bdb097f04a1fa3fb25bcd9759283fb63871 6aa9b7693c850f5465f140d3cfcd1e5884232c1c refs/heads/master\\n\""}2176gitlab # [ 516.211286] gitaly[986]: time="2026-09-04T07:47:34.616Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:44.227" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:34.597" grpc.time_ms=18.553 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 516.224258] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:34.652Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2a9f05d12e1d0fad954a279b","created_at":"2026-09-04T07:47:34.648Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-2aa5a4b56f694b7d","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"ccf934b41399046278788416","job_size_bytes":46,"pid":4052,"job_status":"deduplicated","message":"ProjectCacheWorker JID-2a9f05d12e1d0fad954a279b: deduplicated: until executing","deduplication.type":"until executing"}2178gitlab # [ 516.238624] gitaly[986]: time="2026-09-04T07:47:34.644Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:47:44.256" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:34.627" grpc.time_ms=16.694 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 516.252970] gitaly[986]: time="2026-09-04T07:47:34.698Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-04T07:47:44.009" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:34.679" grpc.time_ms=18.739 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2180gitlab # [ 516.269605] gitaly[986]: time="2026-09-04T07:47:34.729Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-04T07:48:04.208" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:34.708" grpc.time_ms=20.485 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 516.304809] gitaly[986]: time="2026-09-04T07:47:34.764Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-04T07:47:44.062" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-04T07:47:34.753" grpc.time_ms=11.256 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2182gitlab # [ 516.341917] gitaly[986]: time="2026-09-04T07:47:34.801Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:44.093" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:34.784" grpc.time_ms=17.366 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2184gitlab # [ 516.526019] nixbot[4118]: INFO: ::ffff:127.0.0.1:48916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2185gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.07 seconds)2186gitlab # [ 516.699142] gitaly[986]: time="2026-09-04T07:47:35.158Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-04T07:47:44.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:35.000" grpc.time_ms=158.327 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2187gitlab # [ 516.738539] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:35.189Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","7b346bdb097f04a1fa3fb25bcd9759283fb63871 6aa9b7693c850f5465f140d3cfcd1e5884232c1c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7050681612d33d6ff1647744","created_at":"2026-09-04T07:45:55.069Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-c35e2bdc9f494609","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:45:55.071Z","job_size_bytes":185,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7050681612d33d6ff1647744: done: 0.629341 sec","job_status":"done","queue_duration_s":99.48805,"scheduling_latency_s":99.488078,"gitaly_calls":7,"gitaly_duration_s":0.292606,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.035818,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003558,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001913,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006805,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.011449,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012093,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.048,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.048,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.445774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089902,"exclusive_lock_hold_duration_s":0.03234934,"duration_s":0.629341,"completed_at":"2026-09-04T07:47:35.189Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049566,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2188gitlab # [ 516.823792] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:35.191Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c1166fbe5da872e99ada3305","created_at":"2026-09-04T07:45:57.141Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-8e1d3a46a25e418c","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:57.157Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c1166fbe5da872e99ada3305: start","job_status":"start","queue_duration_s":98.034261,"scheduling_latency_s":98.034295}2189gitlab # [ 516.855610] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:35.314Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c1166fbe5da872e99ada3305","created_at":"2026-09-04T07:45:57.141Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-8e1d3a46a25e418c","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:57.157Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c1166fbe5da872e99ada3305: done: 0.123613 sec","job_status":"done","queue_duration_s":98.034261,"scheduling_latency_s":98.034295,"redis_calls":16,"redis_duration_s":0.00575,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003333,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004577,"duration_s":0.123613,"completed_at":"2026-09-04T07:47:35.314Z","load_balancing_strategy":"primary","db_duration_s":0.038573,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2190gitlab # [ 516.914675] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:35.317Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"cbfbeee1b6d14ea1fcf36cb3","created_at":"2026-09-04T07:45:57.159Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-8e1d3a46a25e418c","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:57.172Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-cbfbeee1b6d14ea1fcf36cb3: start","job_status":"start","queue_duration_s":98.144342,"scheduling_latency_s":98.144366}2191gitlab # [ 517.016734] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:35.475Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"cbfbeee1b6d14ea1fcf36cb3","created_at":"2026-09-04T07:45:57.159Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-8e1d3a46a25e418c","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:57.172Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-cbfbeee1b6d14ea1fcf36cb3: done: 0.158679 sec","job_status":"done","queue_duration_s":98.144342,"scheduling_latency_s":98.144366,"redis_calls":21,"redis_duration_s":0.006421,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002751,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001907,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047338,"duration_s":0.158679,"completed_at":"2026-09-04T07:47:35.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051333,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2192gitlab # [ 517.101229] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:35.478Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"097b94ee802cdef87b978b7f","created_at":"2026-09-04T07:45:57.416Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-8e1d3a46a25e418c","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:57.428Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-097b94ee802cdef87b978b7f: start","job_status":"start","queue_duration_s":98.049747,"scheduling_latency_s":98.049776}2193gitlab # [ 517.337289] gitaly[986]: time="2026-09-04T07:47:35.795Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:35.792" grpc.time_ms=3.759 pid=986 span.kind=server system=grpc2194gitlab # [ 517.391041] gitaly[986]: time="2026-09-04T07:47:35.850Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:35.849" grpc.time_ms=0.842 pid=986 span.kind=server system=grpc2195gitlab # [ 517.441327] gitaly[986]: time="2026-09-04T07:47:35.901Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:35.899" grpc.time_ms=1.011 pid=986 span.kind=server system=grpc2196gitlab # [ 517.470774] gitaly[986]: time="2026-09-04T07:47:35.916Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J diskcache=35e085a4-61ac-4bfb-af2f-7c7cf1cd0ce3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:05.232" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:35.733" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2197gitlab # [ 517.492694] gitaly[986]: time="2026-09-04T07:47:35.916Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=204 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7518 command.oublock=0 command.real_time_ms=174 command.spawn_token_fork_ms=1 command.system_time_ms=100 command.user_time_ms=104 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:05.232" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:35.733" grpc.time_ms=182.977 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2198gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2199gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2200gitlab # [ 517.594747] nixbot[4118]: INFO: ::ffff:127.0.0.1:48920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2201gitlab # [ 517.695944] gitaly[986]: time="2026-09-04T07:47:36.155Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:06.053" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.153" grpc.time_ms=1.656 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2202gitlab # [ 517.782172] gitaly[986]: time="2026-09-04T07:47:36.241Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP399YQQJHAJ05F2YR9J3J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:06.139" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.240" grpc.time_ms=1.449 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2203gitlab # [ 517.822029] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.280Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"097b94ee802cdef87b978b7f","created_at":"2026-09-04T07:45:57.416Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-8e1d3a46a25e418c","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:45:57.428Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-097b94ee802cdef87b978b7f: done: 0.802799 sec","job_status":"done","queue_duration_s":98.049747,"scheduling_latency_s":98.049776,"gitaly_calls":3,"gitaly_duration_s":0.199743,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.041871,"redis_read_bytes":457,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001845,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003175,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015041,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006436,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.008892,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000928,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000766,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002943,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":53,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":53,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.117,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":36,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.035,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.041,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.465011,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.70765084,"duration_s":0.802799,"completed_at":"2026-09-04T07:47:36.280Z","load_balancing_strategy":"primary","db_duration_s":0.132525,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2204gitlab # [ 517.916420] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.283Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ccf934b41399046278788416","created_at":"2026-09-04T07:47:33.102Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:33.123Z","job_size_bytes":46,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ccf934b41399046278788416: start","job_status":"start","queue_duration_s":3.159901,"scheduling_latency_s":3.159936}2205gitlab # [ 517.934892] gitaly[986]: time="2026-09-04T07:47:36.368Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-04T13:47:36.357" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:36.358" grpc.time_ms=10.032 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2206gitlab # [ 517.946172] gitaly[986]: time="2026-09-04T07:47:36.397Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:48:06.281" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.381" grpc.time_ms=15.871 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab # [ 517.984570] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.443Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ccf934b41399046278788416","created_at":"2026-09-04T07:47:33.102Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:33.123Z","job_size_bytes":46,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ccf934b41399046278788416: done: 0.160136 sec","job_status":"done","queue_duration_s":3.159901,"scheduling_latency_s":3.159936,"gitaly_calls":2,"gitaly_duration_s":0.033295,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010349,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002032,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000844,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002312,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004067,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046618,"duration_s":0.160136,"completed_at":"2026-09-04T07:47:36.443Z","load_balancing_strategy":"primary","db_duration_s":0.019188,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2208gitlab # [ 518.045138] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.446Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"87e7cf437c74bd1d0802a80a","created_at":"2026-09-04T07:47:33.158Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:33.165Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-87e7cf437c74bd1d0802a80a: start","job_status":"start","queue_duration_s":3.280715,"scheduling_latency_s":3.280745}2209gitlab # [ 518.062139] gitaly[986]: time="2026-09-04T07:47:36.516Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 diskcache=a1441d86-effb-41f2-a4cc-b77789b3fda4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:36.480" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.481" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2210gitlab # [ 518.071921] gitaly[986]: time="2026-09-04T07:47:36.517Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=4 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:36.480" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.481" grpc.time_ms=34.939 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2211gitlab # [ 518.134273] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.592Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"87e7cf437c74bd1d0802a80a","created_at":"2026-09-04T07:47:33.158Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:33.165Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-87e7cf437c74bd1d0802a80a: done: 0.146667 sec","job_status":"done","queue_duration_s":3.280715,"scheduling_latency_s":3.280745,"gitaly_calls":1,"gitaly_duration_s":0.038855,"redis_calls":15,"redis_duration_s":0.005434,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00209,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000965,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.024,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.04,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10842542,"duration_s":0.146667,"completed_at":"2026-09-04T07:47:36.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2212gitlab # [ 518.199498] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.595Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"bb3591f38fb0b140dd898948","created_at":"2026-09-04T07:47:33.367Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:33.371Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bb3591f38fb0b140dd898948: start","job_status":"start","queue_duration_s":3.223991,"scheduling_latency_s":3.224027}2213gitlab # [ 518.216074] gitaly[986]: time="2026-09-04T07:47:36.663Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-04T07:48:06.544" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.644" grpc.time_ms=18.97 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2214gitlab # [ 518.228969] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.685Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"bb3591f38fb0b140dd898948","created_at":"2026-09-04T07:47:33.367Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:33.371Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-bb3591f38fb0b140dd898948: done: 0.090485 sec","job_status":"done","queue_duration_s":3.223991,"scheduling_latency_s":3.224027,"gitaly_calls":1,"gitaly_duration_s":0.022781,"redis_calls":16,"redis_duration_s":0.006777,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000539,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002865,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001585,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090485,"completed_at":"2026-09-04T07:47:36.685Z","load_balancing_strategy":"primary","db_duration_s":0.005033,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2215gitlab # [ 518.272898] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:36.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f7a9b3f1f78ddcce9c03bb93","created_at":"2026-09-04T07:47:34.229Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0d569b3dfd7ccd49386c56b4e12cda2b308158a6b48ab4eae343e2639b426f9a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.241Z","job_size_bytes":467,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f7a9b3f1f78ddcce9c03bb93: start","job_status":"start","queue_duration_s":2.447926,"scheduling_latency_s":2.447975}2216gitlab # [ 518.289827] gitaly[986]: time="2026-09-04T07:47:36.748Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:06.645" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.746" grpc.time_ms=1.247 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2217gitlab # [ 518.309702] gitaly[986]: time="2026-09-04T07:47:36.769Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:47:46.062" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:36.752" grpc.time_ms=16.474 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2218gitlab # [ 518.495645] gitaly[986]: time="2026-09-04T07:47:36.954Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:06.851" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.952" grpc.time_ms=1.607 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2219gitlab # [ 518.533971] gitaly[986]: time="2026-09-04T07:47:36.967Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=34 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:48:06.862" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:36.962" grpc.time_ms=4.672 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2220gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2221gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.07 seconds)2222gitlab # [ 518.663096] nixbot[4118]: INFO: ::ffff:127.0.0.1:48928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2223gitlab # [ 518.696625] gitaly[986]: time="2026-09-04T07:47:37.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:47.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:37.138" grpc.time_ms=17.849 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2224gitlab # [ 519.351698] gitaly[986]: time="2026-09-04T07:47:37.811Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:48:07.681" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:37.782" grpc.time_ms=29.069 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2225gitlab # [ 519.384764] gitaly[986]: time="2026-09-04T07:47:37.844Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP31D4NYZR6AVNP1AF6YN6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:48:07.717" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:37.817" grpc.time_ms=26.727 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2226gitlab # [ 519.453058] sidekiq-cluster[4052]: {"severity":"WARN","time":"2026-09-04T07:47:37.911Z","class":"CreatePipelineWorker","correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"7b346bdb097f04a1fa3fb25bcd9759283fb63871","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"7b346bdb097f04a1fa3fb25bcd9759283fb63871","ref":"refs/heads/master"},"retry":0}2227gitlab # [ 519.470857] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:37.927Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f7a9b3f1f78ddcce9c03bb93","created_at":"2026-09-04T07:47:34.229Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0d569b3dfd7ccd49386c56b4e12cda2b308158a6b48ab4eae343e2639b426f9a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.241Z","job_size_bytes":467,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f7a9b3f1f78ddcce9c03bb93: done: 1.23846 sec","job_status":"done","queue_duration_s":2.447926,"scheduling_latency_s":2.447975,"gitaly_calls":7,"gitaly_duration_s":0.126391,"redis_calls":51,"redis_duration_s":0.016433,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.001396,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006522,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004579,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001777,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.021983,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063144,"duration_s":1.23846,"completed_at":"2026-09-04T07:47:37.927Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.089869,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2228gitlab # [ 519.541801] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:37.931Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a49b52dd-6070-4ea0-84d6-acdb5a582bab\"}"],"class":"WebHookWorker","jid":"9612f7068e7e1cf18327cf45","created_at":"2026-09-04T07:47:34.466Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a1719dc081fa984bd5ae7b0e120e8485a2e9f98400a502a569f8d136eff660be","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.474Z","job_size_bytes":1751,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9612f7068e7e1cf18327cf45: start","job_status":"start","queue_duration_s":3.456931,"scheduling_latency_s":3.456972}2229gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2230gitlab # [ 519.725038] nixbot[4118]: INFO: ::ffff:127.0.0.1:48942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2231gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.06 seconds)2232gitlab # [ 519.731663] nixbot[4118]: INFO: ::ffff:127.0.0.1:48940 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2233gitlab # [ 519.774729] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:38.233Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a49b52dd-6070-4ea0-84d6-acdb5a582bab\"}"],"class":"WebHookWorker","jid":"9612f7068e7e1cf18327cf45","created_at":"2026-09-04T07:47:34.466Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-16ca4323fae34829","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:a1719dc081fa984bd5ae7b0e120e8485a2e9f98400a502a569f8d136eff660be","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.474Z","job_size_bytes":1751,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9612f7068e7e1cf18327cf45: done: 0.301985 sec","job_status":"done","queue_duration_s":3.456931,"scheduling_latency_s":3.456972,"redis_calls":19,"redis_duration_s":0.007496,"redis_read_bytes":32,"redis_write_bytes":5365,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001933,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000681,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002915,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001967,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09888378000005105,"cpu_s":0.176604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006773,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.301985,"completed_at":"2026-09-04T07:47:38.232Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005913,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 519.877837] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:38.238Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"6e5ceae859da40543f82bb5f","created_at":"2026-09-04T07:47:34.666Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-2aa5a4b56f694b7d","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"87e7cf437c74bd1d0802a80a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.671Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-6e5ceae859da40543f82bb5f: start","job_status":"start","queue_duration_s":3.566181,"scheduling_latency_s":3.566234}2235gitlab # [ 519.900358] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:38.330Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"6e5ceae859da40543f82bb5f","created_at":"2026-09-04T07:47:34.666Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-2aa5a4b56f694b7d","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"87e7cf437c74bd1d0802a80a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.671Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-6e5ceae859da40543f82bb5f: done: 0.093018 sec","job_status":"done","queue_duration_s":3.566181,"scheduling_latency_s":3.566234,"gitaly_calls":1,"gitaly_duration_s":0.018315,"redis_calls":12,"redis_duration_s":0.004735,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001849,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000955,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05000354,"duration_s":0.093018,"completed_at":"2026-09-04T07:47:38.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008978,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2236gitlab # [ 519.947355] gitaly[986]: time="2026-09-04T07:47:38.295Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC diskcache=79f0678f-0cb4-418c-8d01-4fd0a25aa71f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:38.281" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:38.282" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237gitlab # [ 519.957330] gitaly[986]: time="2026-09-04T07:47:38.296Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-04T13:47:38.281" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:38.282" grpc.time_ms=13.678 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2238gitlab # [ 519.970826] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1542239gitlab # [ 519.973764] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:38.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"527ff7acfdd9e9ea66ba40a5","created_at":"2026-09-04T07:47:34.912Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-2aa5a4b56f694b7d","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e5fe6b75934dbdd832995ce0458b803b6bbe1859a25f6e6e662a10e29eba5596","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.919Z","job_size_bytes":467,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-527ff7acfdd9e9ea66ba40a5: start","job_status":"start","queue_duration_s":3.414415,"scheduling_latency_s":3.414458}2240gitlab # [ 519.990924] gitaly[986]: time="2026-09-04T07:47:38.375Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:08.273" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:38.374" grpc.time_ms=1.083 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2241gitlab # [ 520.003329] gitaly[986]: time="2026-09-04T07:47:38.391Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:47:48.250" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:38.380" grpc.time_ms=7.467 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2242gitlab # [ 520.016091] gitaly[986]: time="2026-09-04T07:47:38.393Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6CM0G8PHN5SAXB9V0QWW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=202 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:38.374" grpc.time_ms=19.1 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2243gitlab # [ 520.029038] gitaly[986]: time="2026-09-04T07:47:38.443Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:08.342" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:38.442" grpc.time_ms=0.676 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2244gitlab # [ 520.041596] gitaly[986]: time="2026-09-04T07:47:38.455Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=225 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-04T07:48:08.346" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:38.446" grpc.time_ms=8.183 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2245gitlab # [ 520.057560] gitaly[986]: time="2026-09-04T07:47:38.501Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:48.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:38.488" grpc.time_ms=13.183 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2246gitlab # [ 520.098405] gitaly[986]: time="2026-09-04T07:47:38.558Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6CRXB1A8SJE9061RD785 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:38.539" pid=986 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2247gitlab # [ 520.109339] gitaly[986]: time="2026-09-04T07:47:38.558Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6CRXB1A8SJE9061RD785 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:38.539" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2248gitlab # [ 520.122538] gitlab-workhorse[871]: time="2026-09-04T07:47:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672249gitlab # [ 520.124373] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1612250gitlab # [ 520.126251] gitaly[986]: time="2026-09-04T07:47:38.558Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6CRXB1A8SJE9061RD785 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:38.539" grpc.time_ms=18.907 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2251gitlab # [ 520.160382] nixbot[4118]: {"ts": "2026-09-04T07:47:38.619Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2252gitlab # [ 520.301017] gitaly[986]: time="2026-09-04T07:47:38.760Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:08.258" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:38.759" grpc.time_ms=1.245 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2253gitlab # [ 520.449144] gitaly[986]: time="2026-09-04T07:47:38.908Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:48.129" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:38.889" grpc.time_ms=18.876 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2254gitlab # [ 520.572969] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3882255gitlab # [ 520.582515] nixbot[4118]: {"ts": "2026-09-04T07:47:39.034Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 \"HTTP/1.1 201 Created\""}2256gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2257gitlab # [ 520.710978] gitaly[986]: time="2026-09-04T07:47:39.170Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6DCZQQ7RK68Z6BBTDP8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:09.068" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:39.169" grpc.time_ms=1.272 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2258gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.04 seconds)2259gitlab # [ 520.770368] nixbot[4118]: INFO: ::ffff:127.0.0.1:48948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2260gitlab # [ 520.776818] gitaly[986]: time="2026-09-04T07:47:39.236Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=5 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-04T07:48:09.105" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:39.205" grpc.time_ms=30.993 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2261gitlab # [ 520.816772] gitaly[986]: time="2026-09-04T07:47:39.254Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NP3741Z8Y8E3HKW1K2FGMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-04T07:48:09.139" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:39.240" grpc.time_ms=13.605 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2262gitlab # [ 520.839583] sidekiq-cluster[4052]: {"severity":"WARN","time":"2026-09-04T07:47:39.272Z","class":"CreatePipelineWorker","correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"7b346bdb097f04a1fa3fb25bcd9759283fb63871","after":"6aa9b7693c850f5465f140d3cfcd1e5884232c1c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"6aa9b7693c850f5465f140d3cfcd1e5884232c1c","ref":"refs/heads/master"},"retry":0}2263gitlab # [ 520.849723] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"527ff7acfdd9e9ea66ba40a5","created_at":"2026-09-04T07:47:34.912Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-2aa5a4b56f694b7d","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e5fe6b75934dbdd832995ce0458b803b6bbe1859a25f6e6e662a10e29eba5596","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.919Z","job_size_bytes":467,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-527ff7acfdd9e9ea66ba40a5: done: 0.944731 sec","job_status":"done","queue_duration_s":3.414415,"scheduling_latency_s":3.414458,"gitaly_calls":7,"gitaly_duration_s":0.100003,"redis_calls":33,"redis_duration_s":0.006173,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000702,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002681,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001448,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.80169,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.944731,"completed_at":"2026-09-04T07:47:39.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042717,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2264gitlab # [ 520.912290] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.280Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c69e31cc-4ead-43a7-894b-7dda032c2b2c\"}"],"class":"WebHookWorker","jid":"9e01b253ea1cd90b11609199","created_at":"2026-09-04T07:47:34.961Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-2aa5a4b56f694b7d","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9618c6c2cd15e403c458289f69d54fe5241a81b3603c3ddab5d230941fa10738","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.967Z","job_size_bytes":1749,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9e01b253ea1cd90b11609199: start","job_status":"start","queue_duration_s":4.312598,"scheduling_latency_s":4.312627}2265gitlab # [ 520.958058] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.324Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c69e31cc-4ead-43a7-894b-7dda032c2b2c\"}"],"class":"WebHookWorker","jid":"9e01b253ea1cd90b11609199","created_at":"2026-09-04T07:47:34.961Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-2aa5a4b56f694b7d","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9618c6c2cd15e403c458289f69d54fe5241a81b3603c3ddab5d230941fa10738","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:34.967Z","job_size_bytes":1749,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9e01b253ea1cd90b11609199: done: 0.043941 sec","job_status":"done","queue_duration_s":4.312598,"scheduling_latency_s":4.312627,"redis_calls":14,"redis_duration_s":0.002478,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000236,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001627,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008785999999986416,"cpu_s":0.027128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.043941,"completed_at":"2026-09-04T07:47:39.324Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2266gitlab # [ 521.037579] gitaly[986]: time="2026-09-04T07:47:39.338Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=6 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6DCZQQ7RK68Z6BBTDP8C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:49.156" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:39.316" grpc.time_ms=21.579 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2267gitlab # [ 521.053200] nixbot[4118]: INFO: ::ffff:127.0.0.1:50004 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2268gitlab # [ 521.054567] nixbot[4118]: {"ts": "2026-09-04T07:47:39.405Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 \"HTTP/1.1 201 Created\""}2269gitlab # [ 521.057983] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3632270gitlab # [ 521.060854] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 712271gitlab # [ 521.063206] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.326Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"01e3918a78aa05861a07cae7","created_at":"2026-09-04T07:47:35.695Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:35.705Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-01e3918a78aa05861a07cae7: start","job_status":"start","queue_duration_s":3.620849,"scheduling_latency_s":3.620869}2272gitlab # [ 521.079915] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.437Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"01e3918a78aa05861a07cae7","created_at":"2026-09-04T07:47:35.695Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:35.705Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-01e3918a78aa05861a07cae7: done: 0.111473 sec","job_status":"done","queue_duration_s":3.620849,"scheduling_latency_s":3.620869,"redis_calls":10,"redis_duration_s":0.002829,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001154,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000379,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041868,"duration_s":0.111473,"completed_at":"2026-09-04T07:47:39.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017076,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2273gitlab # [ 521.123851] gitaly[986]: time="2026-09-04T07:47:39.439Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6DQ8Y9E909SYZBPZQ181 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.422" grpc.time_ms=16.899 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2274gitlab # [ 521.137113] gitaly[986]: time="2026-09-04T07:47:39.520Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6DSS3SNQSB68JD1AR6H2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.505" pid=986 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2275gitlab # [ 521.147241] gitlab-workhorse[871]: time="2026-09-04T07:47:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672276gitlab # [ 521.149150] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 722277gitlab # [ 521.151031] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.440Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"aeea8bff519f0dccc6bacdfc","created_at":"2026-09-04T07:47:35.928Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:35.940Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-aeea8bff519f0dccc6bacdfc: start","job_status":"start","queue_duration_s":3.499799,"scheduling_latency_s":3.499828}2278gitlab # [ 521.167869] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.484Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"aeea8bff519f0dccc6bacdfc","created_at":"2026-09-04T07:47:35.928Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:35.940Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-aeea8bff519f0dccc6bacdfc: done: 0.044124 sec","job_status":"done","queue_duration_s":3.499799,"scheduling_latency_s":3.499828,"redis_calls":10,"redis_duration_s":0.004003,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000775,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030454,"duration_s":0.044124,"completed_at":"2026-09-04T07:47:39.484Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2279gitlab # [ 521.213956] gitaly[986]: time="2026-09-04T07:47:39.520Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6DSS3SNQSB68JD1AR6H2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.505" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2280gitlab # [ 521.227197] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d77d6ceacd6d870b597d17f0","created_at":"2026-09-04T07:47:35.973Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:35.984Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d77d6ceacd6d870b597d17f0: start","job_status":"start","queue_duration_s":3.501466,"scheduling_latency_s":3.501487}2281gitlab # [ 521.243012] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.533Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d77d6ceacd6d870b597d17f0","created_at":"2026-09-04T07:47:35.973Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:35.984Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d77d6ceacd6d870b597d17f0: done: 0.047314 sec","job_status":"done","queue_duration_s":3.501466,"scheduling_latency_s":3.501487,"redis_calls":10,"redis_duration_s":0.0036119999999999998,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029662,"duration_s":0.047314,"completed_at":"2026-09-04T07:47:39.533Z","load_balancing_strategy":"primary","db_duration_s":0.005938,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2282gitlab # [ 521.286323] gitaly[986]: time="2026-09-04T07:47:39.521Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6DSS3SNQSB68JD1AR6H2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.505" grpc.time_ms=15.365 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2283gitlab # [ 521.300554] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1332284gitlab # [ 521.302576] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.539Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d4020137ecb163941564d82d","created_at":"2026-09-04T07:47:36.010Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.020Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d4020137ecb163941564d82d: start","job_status":"start","queue_duration_s":3.518467,"scheduling_latency_s":3.518491}2285gitlab # [ 521.317821] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.615Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d4020137ecb163941564d82d","created_at":"2026-09-04T07:47:36.010Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.020Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d4020137ecb163941564d82d: done: 0.076644 sec","job_status":"done","queue_duration_s":3.518467,"scheduling_latency_s":3.518491,"redis_calls":13,"redis_duration_s":0.022739000000000002,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002955,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.005914,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002876,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00345958,"duration_s":0.076644,"completed_at":"2026-09-04T07:47:39.615Z","load_balancing_strategy":"primary","db_duration_s":0.011647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 521.362309] gitaly[986]: time="2026-09-04T07:47:39.692Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6DRJ62H3WVV974MSTSX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:09.191" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:39.691" grpc.time_ms=0.757 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2287gitlab # [ 521.375157] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.623Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1fdb14424c0a6712db3d41b7","created_at":"2026-09-04T07:47:36.021Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.031Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1fdb14424c0a6712db3d41b7: start","job_status":"start","queue_duration_s":3.592011,"scheduling_latency_s":3.59204}2288gitlab # [ 521.391516] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1fdb14424c0a6712db3d41b7","created_at":"2026-09-04T07:47:36.021Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.031Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1fdb14424c0a6712db3d41b7: done: 0.055573 sec","job_status":"done","queue_duration_s":3.592011,"scheduling_latency_s":3.59204,"redis_calls":10,"redis_duration_s":0.007005,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002175,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033926,"duration_s":0.055573,"completed_at":"2026-09-04T07:47:39.678Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2289gitlab # [ 521.436917] nixbot[4118]: {"ts": "2026-09-04T07:47:39.812Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 \"HTTP/1.1 201 Created\""}2290gitlab # [ 521.439585] gitlab-workhorse[871]: time="2026-09-04T07:47:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672291gitlab # [ 521.441478] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 882292gitlab # [ 521.443304] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/7b346bdb097f04a1fa3fb25bcd9759283fb63871 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4042293gitlab # [ 521.445854] gitaly[986]: time="2026-09-04T07:47:39.693Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6DX8MW9995B11C230W9Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.680" grpc.time_ms=12.609 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2294gitlab # [ 521.458898] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2b8ffce360a17a4b36f13214","created_at":"2026-09-04T07:47:36.032Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.040Z","job_size_bytes":19,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2b8ffce360a17a4b36f13214: start","job_status":"start","queue_duration_s":3.644488,"scheduling_latency_s":3.644514}2295gitlab # [ 521.475391] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.732Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2b8ffce360a17a4b36f13214","created_at":"2026-09-04T07:47:36.032Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.040Z","job_size_bytes":19,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2b8ffce360a17a4b36f13214: done: 0.048362 sec","job_status":"done","queue_duration_s":3.644488,"scheduling_latency_s":3.644514,"redis_calls":11,"redis_duration_s":0.010288,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000714,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00916,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0043455,"duration_s":0.048362,"completed_at":"2026-09-04T07:47:39.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2296gitlab # [ 521.520536] gitaly[986]: time="2026-09-04T07:47:39.751Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6DRJ62H3WVV974MSTSX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:49.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:39.742" grpc.time_ms=8.918 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2297gitlab # [ 521.534063] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.737Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f52b41fa26e8aa448ea06f0b","created_at":"2026-09-04T07:47:36.047Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.059Z","job_size_bytes":66,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f52b41fa26e8aa448ea06f0b: start","job_status":"start","queue_duration_s":3.678077,"scheduling_latency_s":3.6781}2298gitlab # [ 521.552051] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.789Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f52b41fa26e8aa448ea06f0b","created_at":"2026-09-04T07:47:36.047Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.059Z","job_size_bytes":66,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f52b41fa26e8aa448ea06f0b: done: 0.052392 sec","job_status":"done","queue_duration_s":3.678077,"scheduling_latency_s":3.6781,"redis_calls":10,"redis_duration_s":0.008244,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00097,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006463,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000811,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00090154,"duration_s":0.052392,"completed_at":"2026-09-04T07:47:39.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2299gitlab # [ 521.597760] gitaly[986]: time="2026-09-04T07:47:39.784Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E1GCJJ15GATQ5ZSMA1J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.773" pid=986 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2300gitlab # [ 521.609297] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.791Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c285168c9ac2c6bb36ea50d1","created_at":"2026-09-04T07:47:36.062Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.072Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c285168c9ac2c6bb36ea50d1: start","job_status":"start","queue_duration_s":3.71963,"scheduling_latency_s":3.719655}2301gitlab # [ 521.625585] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.855Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"c285168c9ac2c6bb36ea50d1","created_at":"2026-09-04T07:47:36.062Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.072Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c285168c9ac2c6bb36ea50d1: done: 0.063384 sec","job_status":"done","queue_duration_s":3.71963,"scheduling_latency_s":3.719655,"redis_calls":10,"redis_duration_s":0.00839,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002009,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048742,"duration_s":0.063384,"completed_at":"2026-09-04T07:47:39.855Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 521.670048] gitaly[986]: time="2026-09-04T07:47:39.784Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E1GCJJ15GATQ5ZSMA1J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.773" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2303gitlab # [ 521.683630] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.856Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ec52a7059b82089193395991","created_at":"2026-09-04T07:47:36.087Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.097Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ec52a7059b82089193395991: start","job_status":"start","queue_duration_s":3.759442,"scheduling_latency_s":3.759465}2304gitlab # [ 521.699993] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.901Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"ec52a7059b82089193395991","created_at":"2026-09-04T07:47:36.087Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.097Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-ec52a7059b82089193395991: done: 0.044284 sec","job_status":"done","queue_duration_s":3.759442,"scheduling_latency_s":3.759465,"redis_calls":10,"redis_duration_s":0.002495,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001344,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000505,"duration_s":0.044284,"completed_at":"2026-09-04T07:47:39.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2305gitlab # [ 521.743528] gitaly[986]: time="2026-09-04T07:47:39.785Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E1GCJJ15GATQ5ZSMA1J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:47:39.773" grpc.time_ms=11.982 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc2306gitlab # [ 521.757915] nixbot[4118]: {"ts": "2026-09-04T07:47:40.159Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c \"HTTP/1.1 201 Created\""}2307gitlab # [ 521.760655] nixbot[4118]: {"ts": "2026-09-04T07:47:40.167Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-6aa9b7693c85-5"}2308gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c'2309gitlab # [ 521.762927] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6cd3788cce9d0932e74b873c","created_at":"2026-09-04T07:47:36.098Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.106Z","job_size_bytes":6,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6cd3788cce9d0932e74b873c: start","job_status":"start","queue_duration_s":3.79774,"scheduling_latency_s":3.797765}2310gitlab # [ 521.777969] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6cd3788cce9d0932e74b873c","created_at":"2026-09-04T07:47:36.098Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.106Z","job_size_bytes":6,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6cd3788cce9d0932e74b873c: done: 0.037643 sec","job_status":"done","queue_duration_s":3.79774,"scheduling_latency_s":3.797765,"redis_calls":10,"redis_duration_s":0.0032540000000000004,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000359,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0015449,"duration_s":0.037643,"completed_at":"2026-09-04T07:47:39.942Z","load_balancing_strategy":"primary","db_duration_s":0.006358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2311gitlab # [ 521.820369] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3272312gitlab # [ 521.822849] gitaly[986]: time="2026-09-04T07:47:39.893Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:09.792" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:39.892" grpc.time_ms=0.677 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2313gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c', in 0.07 seconds)2314(finished: subtest: push delivers the webhook, in 106.33 seconds)2315subtest: eval and build post commit statuses2316gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2317gitlab # [ 521.835503] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.943Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0d5d79ef1ace3d923c760089","created_at":"2026-09-04T07:47:36.107Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.115Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0d5d79ef1ace3d923c760089: start","job_status":"start","queue_duration_s":3.82811,"scheduling_latency_s":3.828127}2318gitlab # [ 521.851139] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0d5d79ef1ace3d923c760089","created_at":"2026-09-04T07:47:36.107Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.115Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0d5d79ef1ace3d923c760089: done: 0.04965 sec","job_status":"done","queue_duration_s":3.82811,"scheduling_latency_s":3.828127,"redis_calls":10,"redis_duration_s":0.001813,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033196,"duration_s":0.04965,"completed_at":"2026-09-04T07:47:39.993Z","load_balancing_strategy":"primary","db_duration_s":0.015082,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2319gitlab # [ 521.893408] gitaly[986]: time="2026-09-04T07:47:39.913Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:48:09.801" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:39.901" grpc.time_ms=12.062 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2320gitlab # [ 521.907466] nixbot[4118]: INFO: ::ffff:127.0.0.1:50008 - "GET /api/repos/gitlab/root/test-flake/builds?commit=6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 200 OK2321gitlab # [ 521.909475] nixbot[4118]: {"ts": "2026-09-04T07:47:40.331Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-6aa9b7693c85-5", "argv0": "bwrap"}2322gitlab # [ 521.911798] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:39.994Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1501b4b66fc8667762f71c74","created_at":"2026-09-04T07:47:36.125Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.134Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1501b4b66fc8667762f71c74: start","job_status":"start","queue_duration_s":3.860475,"scheduling_latency_s":3.860499}2323gitlab # [ 521.927841] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.085Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"1501b4b66fc8667762f71c74","created_at":"2026-09-04T07:47:36.125Z","trace_propagation_headers":{"sentry-trace":"7f70b0fcd11d4394b0b2fbe0f812c44e-eb26ba92c6f04aa3","baggage":"sentry-trace_id=7f70b0fcd11d4394b0b2fbe0f812c44e,sentry-release=Unknown"},"correlation_id":"01M1NP399YQQJHAJ05F2YR9J3J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.134Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-1501b4b66fc8667762f71c74: done: 0.090724 sec","job_status":"done","queue_duration_s":3.860475,"scheduling_latency_s":3.860499,"redis_calls":14,"redis_duration_s":0.00734,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002773,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00182524,"duration_s":0.090724,"completed_at":"2026-09-04T07:47:40.085Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2324gitlab # [ 521.971260] gitaly[986]: time="2026-09-04T07:47:39.935Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:47:49.184" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:39.925" grpc.time_ms=10.081 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2325gitlab # [ 521.984640] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.089Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1b7102a29069920cb4d1c411","created_at":"2026-09-04T07:47:36.413Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-8101d31b991a4a5c","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.422Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1b7102a29069920cb4d1c411: start","job_status":"start","queue_duration_s":3.667017,"scheduling_latency_s":3.667057}2326gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.17 seconds)2327gitlab # [ 522.000330] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.190Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1b7102a29069920cb4d1c411","created_at":"2026-09-04T07:47:36.413Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-8101d31b991a4a5c","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:36.422Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1b7102a29069920cb4d1c411: done: 0.101161 sec","job_status":"done","queue_duration_s":3.667017,"scheduling_latency_s":3.667057,"redis_calls":19,"redis_duration_s":0.008699,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001601,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000757,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004466,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001875,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01772494,"duration_s":0.101161,"completed_at":"2026-09-04T07:47:40.190Z","load_balancing_strategy":"primary","db_duration_s":0.010424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2328gitlab # [ 522.046551] gitaly[986]: time="2026-09-04T07:47:39.958Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:47:49.217" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:39.957" grpc.time_ms=0.316 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2329gitlab # [ 522.057294] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1272330gitlab # [ 522.059883] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.194Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9612f7068e7e1cf18327cf45"],"class":"WebHooks::LogExecutionWorker","jid":"2f437b4962db064a100817aa","created_at":"2026-09-04T07:47:38.196Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-493fa6df9d2e482f","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4e821b727c2dc6dbb3282d660a6c78b022b0f161fd3da11bf44a911445b903d5","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:38.212Z","job_size_bytes":2592,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2f437b4962db064a100817aa: start","job_status":"start","queue_duration_s":1.981927,"scheduling_latency_s":1.981972}2331gitlab # [ 522.076758] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.264Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9612f7068e7e1cf18327cf45"],"class":"WebHooks::LogExecutionWorker","jid":"2f437b4962db064a100817aa","created_at":"2026-09-04T07:47:38.196Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-493fa6df9d2e482f","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4e821b727c2dc6dbb3282d660a6c78b022b0f161fd3da11bf44a911445b903d5","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:38.212Z","job_size_bytes":2592,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2f437b4962db064a100817aa: done: 0.070754 sec","job_status":"done","queue_duration_s":1.981927,"scheduling_latency_s":1.981972,"redis_calls":10,"redis_duration_s":0.002628,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000527,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046582,"duration_s":0.070754,"completed_at":"2026-09-04T07:47:40.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2332gitlab # [ 522.121288] gitaly[986]: time="2026-09-04T07:47:39.979Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:47:49.223" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:39.963" grpc.time_ms=15.496 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2333gitlab # [ 522.134508] gitaly[986]: time="2026-09-04T07:47:40.023Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:40.022" grpc.time_ms=0.444 pid=986 span.kind=server system=grpc2334gitlab # [ 522.144071] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.267Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"655ee5085cce3656c12cd129","created_at":"2026-09-04T07:47:38.993Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-9554c896770e437d","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:39.003Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-655ee5085cce3656c12cd129: start","job_status":"start","queue_duration_s":1.264337,"scheduling_latency_s":1.264378}2335gitlab # [ 522.159684] gitaly[986]: time="2026-09-04T07:47:40.046Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:40.045" grpc.time_ms=0.478 pid=986 span.kind=server system=grpc2336gitlab # [ 522.169312] gitaly[986]: time="2026-09-04T07:47:40.051Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN diskcache=3d0656f2-64cf-4412-8a06-3c2c5fe721c0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:49.241" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:39.981" pid=986 ref=refs/keep-around/6aa9b7693c850f5465f140d3cfcd1e5884232c1c remote_ip="2001:db8:1::1" revision=6aa9b7693c850f5465f140d3cfcd1e5884232c1c span.kind=server system=grpc username=root2337gitlab # [ 522.180504] gitaly[986]: time="2026-09-04T07:47:40.052Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=60 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5182 command.oublock=8 command.real_time_ms=65 command.spawn_token_fork_ms=2 command.system_time_ms=36 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:47:49.241" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:47:39.981" grpc.time_ms=69.939 pid=986 ref=refs/keep-around/6aa9b7693c850f5465f140d3cfcd1e5884232c1c remote_ip="2001:db8:1::1" revision=6aa9b7693c850f5465f140d3cfcd1e5884232c1c span.kind=server system=grpc username=root2338gitlab # [ 522.194705] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.639Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"655ee5085cce3656c12cd129","created_at":"2026-09-04T07:47:38.993Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-9554c896770e437d","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:39.003Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":4052,"job_status":"rescheduled","message":"PipelineProcessWorker JID-655ee5085cce3656c12cd129: rescheduled"}2339gitlab # [ 522.209391] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.651Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"655ee5085cce3656c12cd129","created_at":"2026-09-04T07:47:38.993Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-9554c896770e437d","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:39.003Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-655ee5085cce3656c12cd129: done: 0.384225 sec","job_status":"done","queue_duration_s":1.264337,"scheduling_latency_s":1.264378,"gitaly_calls":3,"gitaly_duration_s":0.126097,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016517999999999998,"redis_read_bytes":151,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000674,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001318,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.00407,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006389,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00026,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001103,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00203,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.197707,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.3187845,"duration_s":0.384225,"completed_at":"2026-09-04T07:47:40.651Z","load_balancing_strategy":"primary","db_duration_s":0.053273,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2340gitlab # [ 522.278135] gitaly[986]: time="2026-09-04T07:47:40.056Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:10.055" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:40.055" grpc.time_ms=0.364 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2341gitlab # [ 522.307129] gitaly[986]: time="2026-09-04T07:47:40.409Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:40.408" grpc.time_ms=0.761 pid=986 span.kind=server system=grpc2342gitlab # [ 522.323528] nix-daemon[4349]: accepted connection from pid 5059, user nixbot2343gitlab # [ 522.325056] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.654Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9e01b253ea1cd90b11609199"],"class":"WebHooks::LogExecutionWorker","jid":"62ac0f24732dd9bc93f057bd","created_at":"2026-09-04T07:47:39.315Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-a7065d4b44d34a1a","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f9586cf8cf639df00d2eaa294e0d25df367f2169ff5c45d15e090b32102f50fc","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:39.318Z","job_size_bytes":2591,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-62ac0f24732dd9bc93f057bd: start","job_status":"start","queue_duration_s":1.335669,"scheduling_latency_s":1.335708}2344gitlab # [ 522.346712] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.692Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9e01b253ea1cd90b11609199"],"class":"WebHooks::LogExecutionWorker","jid":"62ac0f24732dd9bc93f057bd","created_at":"2026-09-04T07:47:39.315Z","trace_propagation_headers":{"sentry-trace":"dc3fcd87eb114e6f94c74fc5961659dd-a7065d4b44d34a1a","baggage":"sentry-trace_id=dc3fcd87eb114e6f94c74fc5961659dd,sentry-release=Unknown"},"correlation_id":"01M1NP3741Z8Y8E3HKW1K2FGMC","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f9586cf8cf639df00d2eaa294e0d25df367f2169ff5c45d15e090b32102f50fc","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:39.318Z","job_size_bytes":2591,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-62ac0f24732dd9bc93f057bd: done: 0.037968 sec","job_status":"done","queue_duration_s":1.335669,"scheduling_latency_s":1.335708,"redis_calls":7,"redis_duration_s":0.001334,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037968,"completed_at":"2026-09-04T07:47:40.691Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00626,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2345gitlab # [ 522.391171] gitaly[986]: time="2026-09-04T07:47:40.422Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6ENK2JNCNFB28D5HWSH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:10.420" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:40.420" grpc.time_ms=0.915 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2346gitlab # [ 522.404151] gitaly[986]: time="2026-09-04T07:47:40.448Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:40.447" grpc.time_ms=0.542 pid=986 span.kind=server system=grpc2347gitlab # [ 522.413589] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.693Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1de4d432273fd762c737d1e9","created_at":"2026-09-04T07:47:40.057Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-c04283b880d247c1","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.064Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1de4d432273fd762c737d1e9: start","job_status":"start","queue_duration_s":0.628961,"scheduling_latency_s":0.628989}2348gitlab # [ 522.431056] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.755Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1de4d432273fd762c737d1e9","created_at":"2026-09-04T07:47:40.057Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-c04283b880d247c1","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.064Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1de4d432273fd762c737d1e9: done: 0.061697 sec","job_status":"done","queue_duration_s":0.628961,"scheduling_latency_s":0.628989,"redis_calls":7,"redis_duration_s":0.002091,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000592,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061697,"completed_at":"2026-09-04T07:47:40.755Z","load_balancing_strategy":"primary","db_duration_s":0.007336,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2349gitlab # [ 522.473054] gitaly[986]: time="2026-09-04T07:47:40.476Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:40.475" grpc.time_ms=0.584 pid=986 span.kind=server system=grpc2350gitlab # [ 522.482508] gitaly[986]: time="2026-09-04T07:47:40.482Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 diskcache=10f3d6a1-f6e4-4b2c-b202-1a1e35f360ee grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:10.268" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:40.368" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2351gitlab # [ 522.492185] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.759Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"99b025b3ff351bba4e6808a3","created_at":"2026-09-04T07:47:40.066Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-c04283b880d247c1","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.068Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-99b025b3ff351bba4e6808a3: start","job_status":"start","queue_duration_s":0.690255,"scheduling_latency_s":0.690303}2352gitlab # [ 522.509234] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.880Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"99b025b3ff351bba4e6808a3","created_at":"2026-09-04T07:47:40.066Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-c04283b880d247c1","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.068Z","job_size_bytes":65,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-99b025b3ff351bba4e6808a3: done: 0.121304 sec","job_status":"done","queue_duration_s":0.690255,"scheduling_latency_s":0.690303,"redis_calls":10,"redis_duration_s":0.006865,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.003122,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.121304,"completed_at":"2026-09-04T07:47:40.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353gitlab # [ 522.552505] gitaly[986]: time="2026-09-04T07:47:40.483Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=103 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7298 command.oublock=0 command.real_time_ms=109 command.spawn_token_fork_ms=1 command.system_time_ms=50 command.user_time_ms=53 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:10.268" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:40.368" grpc.time_ms=114.372 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2354gitlab # [ 522.565380] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:40.884Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"13c47d6d128ab11de2af8cc7","created_at":"2026-09-04T07:47:40.130Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-c04283b880d247c1","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.134Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-13c47d6d128ab11de2af8cc7: start","job_status":"start","queue_duration_s":0.75045,"scheduling_latency_s":0.75051}2355gitlab # [ 522.580989] gitaly[986]: time="2026-09-04T07:47:40.564Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:10.462" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:40.562" grpc.time_ms=1.361 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2356gitlab # [ 522.593564] gitaly[986]: time="2026-09-04T07:47:40.623Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6D0K1HW2F6K6GVV690N3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:10.521" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:40.621" grpc.time_ms=1.046 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2357gitlab # [ 522.607096] gitaly[986]: time="2026-09-04T07:47:41.066Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:11.064" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:41.064" grpc.time_ms=1.641 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2358gitlab # [ 522.699285] gitaly[986]: time="2026-09-04T07:47:41.159Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6E5PYQ4YBQVTS6GHDVPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:11.156" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:41.157" grpc.time_ms=1.452 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2359gitlab # [ 522.729626] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.186Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"13c47d6d128ab11de2af8cc7","created_at":"2026-09-04T07:47:40.130Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-c04283b880d247c1","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.134Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-13c47d6d128ab11de2af8cc7: done: 0.302085 sec","job_status":"done","queue_duration_s":0.75045,"scheduling_latency_s":0.75051,"gitaly_calls":2,"gitaly_duration_s":0.0129,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016787,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002328,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002394,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000493,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004042,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000551,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001041,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00361,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.240815,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21811428,"duration_s":0.302085,"completed_at":"2026-09-04T07:47:41.186Z","load_balancing_strategy":"primary","db_duration_s":0.048964,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2360gitlab # [ 522.796480] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9bfea089a86fe978c8e6b3a0","created_at":"2026-09-04T07:47:40.159Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-aa8e40c39186450a","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.171Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9bfea089a86fe978c8e6b3a0: start","job_status":"start","queue_duration_s":1.018551,"scheduling_latency_s":1.018596}2361gitlab # [ 522.889195] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.347Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"9bfea089a86fe978c8e6b3a0","created_at":"2026-09-04T07:47:40.159Z","trace_propagation_headers":{"sentry-trace":"3c8d37798ce643ec8ee758ed7412ade0-aa8e40c39186450a","baggage":"sentry-trace_id=3c8d37798ce643ec8ee758ed7412ade0,sentry-release=Unknown"},"correlation_id":"01M1NP31D4NYZR6AVNP1AF6YN6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.171Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-9bfea089a86fe978c8e6b3a0: done: 0.157322 sec","job_status":"done","queue_duration_s":1.018551,"scheduling_latency_s":1.018596,"redis_calls":11,"redis_duration_s":0.004357,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000748,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002879,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00073,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077456,"duration_s":0.157322,"completed_at":"2026-09-04T07:47:41.347Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2362gitlab # [ 522.957911] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.349Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4e085b9bac63b3619ff56938","created_at":"2026-09-04T07:47:40.358Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.361Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4e085b9bac63b3619ff56938: start","job_status":"start","queue_duration_s":0.988865,"scheduling_latency_s":0.988907}2363gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2364gitlab # [ 522.976456] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.435Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4e085b9bac63b3619ff56938","created_at":"2026-09-04T07:47:40.358Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.361Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4e085b9bac63b3619ff56938: done: 0.085222 sec","job_status":"done","queue_duration_s":0.988865,"scheduling_latency_s":0.988907,"redis_calls":7,"redis_duration_s":0.003292,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.085222,"completed_at":"2026-09-04T07:47:41.434Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015508,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2365gitlab # [ 523.019193] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.439Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7027ac151d6afebca2ad3457","created_at":"2026-09-04T07:47:40.489Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.492Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7027ac151d6afebca2ad3457: start","job_status":"start","queue_duration_s":0.947185,"scheduling_latency_s":0.94725}2366gitlab # [ 523.056965] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.515Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7027ac151d6afebca2ad3457","created_at":"2026-09-04T07:47:40.489Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.492Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7027ac151d6afebca2ad3457: done: 0.075718 sec","job_status":"done","queue_duration_s":0.947185,"scheduling_latency_s":0.94725,"redis_calls":7,"redis_duration_s":0.003477,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.075718,"completed_at":"2026-09-04T07:47:41.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2367gitlab # [ 523.105539] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1a46221cc4cb8f8acacb9537","created_at":"2026-09-04T07:47:40.500Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.504Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1a46221cc4cb8f8acacb9537: start","job_status":"start","queue_duration_s":1.018083,"scheduling_latency_s":1.018148}2368gitlab # [ 523.146416] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.605Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1a46221cc4cb8f8acacb9537","created_at":"2026-09-04T07:47:40.500Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.504Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1a46221cc4cb8f8acacb9537: done: 0.082484 sec","job_status":"done","queue_duration_s":1.018083,"scheduling_latency_s":1.018148,"redis_calls":7,"redis_duration_s":0.003692,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002656,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057656,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082484,"completed_at":"2026-09-04T07:47:41.604Z","load_balancing_strategy":"primary","db_duration_s":0.010488,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2369gitlab # [ 523.202904] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.608Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"af0600c6f6c4d38f15e481eb","created_at":"2026-09-04T07:47:40.516Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.518Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-af0600c6f6c4d38f15e481eb: start","job_status":"start","queue_duration_s":1.089908,"scheduling_latency_s":1.089969}2370gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.21 seconds)2371gitlab # [ 523.219162] gitaly[986]: time="2026-09-04T07:47:41.627Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6FVVASKGQH0FNHVY8KTR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:11.125" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:41.626" grpc.time_ms=1.194 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2372gitlab # [ 523.232066] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1132373gitlab # [ 523.235828] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.675Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"af0600c6f6c4d38f15e481eb","created_at":"2026-09-04T07:47:40.516Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.518Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-af0600c6f6c4d38f15e481eb: done: 0.066515 sec","job_status":"done","queue_duration_s":1.089908,"scheduling_latency_s":1.089969,"redis_calls":10,"redis_duration_s":0.003693,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000662,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066515,"completed_at":"2026-09-04T07:47:41.675Z","load_balancing_strategy":"primary","db_duration_s":0.008006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2374gitlab # [ 523.278240] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fca0c2d9a78e9c869c07d596","created_at":"2026-09-04T07:47:40.519Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.523Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fca0c2d9a78e9c869c07d596: start","job_status":"start","queue_duration_s":1.155626,"scheduling_latency_s":1.155667}2375gitlab # [ 523.294688] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.718Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"fca0c2d9a78e9c869c07d596","created_at":"2026-09-04T07:47:40.519Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.523Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-fca0c2d9a78e9c869c07d596: done: 0.040081 sec","job_status":"done","queue_duration_s":1.155626,"scheduling_latency_s":1.155667,"redis_calls":7,"redis_duration_s":0.0025570000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040081,"completed_at":"2026-09-04T07:47:41.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2376gitlab # [ 523.336938] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.720Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"729c758cecb46e129ae7f4c7","created_at":"2026-09-04T07:47:40.524Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.528Z","job_size_bytes":19,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-729c758cecb46e129ae7f4c7: start","job_status":"start","queue_duration_s":1.192274,"scheduling_latency_s":1.192307}2377gitlab # [ 523.352617] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"729c758cecb46e129ae7f4c7","created_at":"2026-09-04T07:47:40.524Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.528Z","job_size_bytes":19,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-729c758cecb46e129ae7f4c7: done: 0.037629 sec","job_status":"done","queue_duration_s":1.192274,"scheduling_latency_s":1.192307,"redis_calls":8,"redis_duration_s":0.002848,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002273,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037629,"completed_at":"2026-09-04T07:47:41.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2378gitlab # [ 523.394581] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.760Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cdb07494c964d6f6a671af13","created_at":"2026-09-04T07:47:40.530Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.533Z","job_size_bytes":66,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cdb07494c964d6f6a671af13: start","job_status":"start","queue_duration_s":1.227885,"scheduling_latency_s":1.227927}2379gitlab # [ 523.411689] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.801Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cdb07494c964d6f6a671af13","created_at":"2026-09-04T07:47:40.530Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.533Z","job_size_bytes":66,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cdb07494c964d6f6a671af13: done: 0.040426 sec","job_status":"done","queue_duration_s":1.227885,"scheduling_latency_s":1.227927,"redis_calls":7,"redis_duration_s":0.002519,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040426,"completed_at":"2026-09-04T07:47:41.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006147,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2380gitlab # [ 523.456075] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.804Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9a7af95a087e6580b97baaa6","created_at":"2026-09-04T07:47:40.534Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.537Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9a7af95a087e6580b97baaa6: start","job_status":"start","queue_duration_s":1.266766,"scheduling_latency_s":1.266807}2381gitlab # [ 523.472119] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.842Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"9a7af95a087e6580b97baaa6","created_at":"2026-09-04T07:47:40.534Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.537Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-9a7af95a087e6580b97baaa6: done: 0.03884 sec","job_status":"done","queue_duration_s":1.266766,"scheduling_latency_s":1.266807,"redis_calls":7,"redis_duration_s":0.002382,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000692,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03884,"completed_at":"2026-09-04T07:47:41.842Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2382gitlab # [ 523.513802] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"435f97d462dddac8b095d511","created_at":"2026-09-04T07:47:40.538Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.541Z","job_size_bytes":6,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-435f97d462dddac8b095d511: start","job_status":"start","queue_duration_s":1.303895,"scheduling_latency_s":1.303928}2383gitlab # [ 523.529144] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.878Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"435f97d462dddac8b095d511","created_at":"2026-09-04T07:47:40.538Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.541Z","job_size_bytes":6,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-435f97d462dddac8b095d511: done: 0.033368 sec","job_status":"done","queue_duration_s":1.303895,"scheduling_latency_s":1.303928,"redis_calls":7,"redis_duration_s":0.003681,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033368,"completed_at":"2026-09-04T07:47:41.878Z","load_balancing_strategy":"primary","db_duration_s":0.000974,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2384gitlab # [ 523.570274] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.882Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5eeb99fd68030443bbb69127","created_at":"2026-09-04T07:47:40.541Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.544Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5eeb99fd68030443bbb69127: start","job_status":"start","queue_duration_s":1.33787,"scheduling_latency_s":1.337928}2385gitlab # [ 523.585467] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.964Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5eeb99fd68030443bbb69127","created_at":"2026-09-04T07:47:40.541Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.544Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5eeb99fd68030443bbb69127: done: 0.082242 sec","job_status":"done","queue_duration_s":1.33787,"scheduling_latency_s":1.337928,"redis_calls":7,"redis_duration_s":0.0071730000000000006,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.082242,"completed_at":"2026-09-04T07:47:41.964Z","load_balancing_strategy":"primary","db_duration_s":0.012684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2386gitlab # [ 523.626162] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:41.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"83ff41b7b2578c49ba93c968","created_at":"2026-09-04T07:47:40.639Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.643Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-83ff41b7b2578c49ba93c968: start","job_status":"start","queue_duration_s":1.325679,"scheduling_latency_s":1.325731}2387gitlab # [ 523.642797] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.029Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"83ff41b7b2578c49ba93c968","created_at":"2026-09-04T07:47:40.639Z","trace_propagation_headers":{"sentry-trace":"74feec94eab8469c92199076fcf018c0-83ff989ed0ef491a","baggage":"sentry-trace_id=74feec94eab8469c92199076fcf018c0,sentry-release=Unknown"},"correlation_id":"01M1NP6D0K1HW2F6K6GVV690N3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:40.643Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-83ff41b7b2578c49ba93c968: done: 0.060634 sec","job_status":"done","queue_duration_s":1.325679,"scheduling_latency_s":1.325731,"redis_calls":8,"redis_duration_s":0.0034260000000000002,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002663,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060634,"completed_at":"2026-09-04T07:47:42.029Z","load_balancing_strategy":"primary","db_duration_s":0.008584,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2388gitlab # [ 523.684428] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.032Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8a3b330e88a7c9cacbce8ae7","created_at":"2026-09-04T07:47:41.031Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-956b657274074f72","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:41.036Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8a3b330e88a7c9cacbce8ae7: start","job_status":"start","queue_duration_s":0.996031,"scheduling_latency_s":0.99607}2389gitlab # [ 523.700481] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.094Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8a3b330e88a7c9cacbce8ae7","created_at":"2026-09-04T07:47:41.031Z","trace_propagation_headers":{"sentry-trace":"6601d356d5854e81bcec6ab5a9af4438-956b657274074f72","baggage":"sentry-trace_id=6601d356d5854e81bcec6ab5a9af4438,sentry-release=Unknown"},"correlation_id":"01M1NP6E5PYQ4YBQVTS6GHDVPN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:41.036Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8a3b330e88a7c9cacbce8ae7: done: 0.062466 sec","job_status":"done","queue_duration_s":0.996031,"scheduling_latency_s":0.99607,"redis_calls":7,"redis_duration_s":0.002541,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.062466,"completed_at":"2026-09-04T07:47:42.094Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009517,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2390gitlab # [ 523.782273] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.241Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"12880cea8d3782345b978285","created_at":"2026-09-04T07:47:42.219Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fe2ac59a0975534525f19029acf994c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.239Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-12880cea8d3782345b978285: start","job_status":"start","queue_duration_s":0.002199,"scheduling_latency_s":0.002247}2391gitlab # [ 523.847418] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.307Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2392gitlab # [ 523.876715] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"12880cea8d3782345b978285","created_at":"2026-09-04T07:47:42.219Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8fe2ac59a0975534525f19029acf994c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.239Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-12880cea8d3782345b978285: done: 0.093738 sec","job_status":"done","queue_duration_s":0.002199,"scheduling_latency_s":0.002247,"redis_calls":9,"redis_duration_s":0.010562,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001951,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002934,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093738,"completed_at":"2026-09-04T07:47:42.335Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2393gitlab # [ 523.962232] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e9b208dfbdba86ff4b782f21","created_at":"2026-09-04T07:47:42.266Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b2fe27591dd67bcdcb7cc01b06015ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.285Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e9b208dfbdba86ff4b782f21: start","job_status":"start","queue_duration_s":0.052652,"scheduling_latency_s":0.052702}2394gitlab # [ 523.979119] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e9b208dfbdba86ff4b782f21","created_at":"2026-09-04T07:47:42.266Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b2fe27591dd67bcdcb7cc01b06015ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.285Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e9b208dfbdba86ff4b782f21: done: 0.098896 sec","job_status":"done","queue_duration_s":0.052652,"scheduling_latency_s":0.052702,"redis_calls":11,"redis_duration_s":0.020937,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004177,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.098896,"completed_at":"2026-09-04T07:47:42.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2395gitlab # [ 524.021488] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7ad730450d3e17381f75c5fc","created_at":"2026-09-04T07:47:42.304Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28eaa0f261856fe9109220448a5b6c40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:47:42.377Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7ad730450d3e17381f75c5fc: start","job_status":"start","queue_duration_s":0.084699,"scheduling_latency_s":0.084759}2396gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2397gitlab # [ 524.156767] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"7ad730450d3e17381f75c5fc","created_at":"2026-09-04T07:47:42.304Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28eaa0f261856fe9109220448a5b6c40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:47:42.377Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-7ad730450d3e17381f75c5fc: done: 0.153091 sec","job_status":"done","queue_duration_s":0.084699,"scheduling_latency_s":0.084759,"redis_calls":9,"redis_duration_s":0.022062000000000002,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002631,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005778,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.153091,"completed_at":"2026-09-04T07:47:42.615Z","load_balancing_strategy":"primary","db_duration_s":0.012859,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2398gitlab # [ 524.247745] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3974fc613c2d6282662a8039","created_at":"2026-09-04T07:47:42.407Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de9276e677295e1fb3070afcab39e4b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:47:42.433Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3974fc613c2d6282662a8039: start","job_status":"start","queue_duration_s":0.200654,"scheduling_latency_s":0.200711}2399gitlab # [ 524.268141] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.726Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}2400gitlab # [ 524.309379] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"3974fc613c2d6282662a8039","created_at":"2026-09-04T07:47:42.407Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de9276e677295e1fb3070afcab39e4b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:47:42.433Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-3974fc613c2d6282662a8039: done: 0.13441 sec","job_status":"done","queue_duration_s":0.200654,"scheduling_latency_s":0.200711,"redis_calls":9,"redis_duration_s":0.013028,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002783,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009295,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035632,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.13441,"completed_at":"2026-09-04T07:47:42.767Z","load_balancing_strategy":"primary","db_duration_s":0.001839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2401gitlab # [ 524.385716] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c2688dbf039a95bf235ccf85","created_at":"2026-09-04T07:47:42.464Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7541a9c5ae85a01135f653341a1e471c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.481Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c2688dbf039a95bf235ccf85: start","job_status":"start","queue_duration_s":0.293594,"scheduling_latency_s":0.293655}2402gitlab # [ 524.402298] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:42.841Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}2403gitlab # [ 524.418110] gitaly[986]: time="2026-09-04T07:47:42.877Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6H1EA6MQVY32EQQ2ZBHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:12.874" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:42.875" grpc.time_ms=1.175 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2404gitlab # [ 524.473991] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1652405gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.26 seconds)2406gitlab # [ 524.625497] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c2688dbf039a95bf235ccf85","created_at":"2026-09-04T07:47:42.464Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7541a9c5ae85a01135f653341a1e471c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.481Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c2688dbf039a95bf235ccf85: done: 0.309463 sec","job_status":"done","queue_duration_s":0.293594,"scheduling_latency_s":0.293655,"redis_calls":9,"redis_duration_s":0.010168,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001684,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003693,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.309463,"completed_at":"2026-09-04T07:47:43.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2407gitlab # [ 524.735143] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"449878e5e6821e782c28a07a","created_at":"2026-09-04T07:47:42.497Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.525Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-449878e5e6821e782c28a07a: start","job_status":"start","queue_duration_s":0.575435,"scheduling_latency_s":0.575497}2408gitlab # [ 524.906361] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"449878e5e6821e782c28a07a","created_at":"2026-09-04T07:47:42.497Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.525Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-449878e5e6821e782c28a07a: done: 0.263469 sec","job_status":"done","queue_duration_s":0.575435,"scheduling_latency_s":0.575497,"redis_calls":18,"redis_duration_s":0.093935,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.012283,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00463,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.06961,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.007412,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.263469,"completed_at":"2026-09-04T07:47:43.364Z","load_balancing_strategy":"primary","db_duration_s":0.013642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2409gitlab # [ 525.000260] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a1aebfb1b356523137b180af","created_at":"2026-09-04T07:47:42.574Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2f0a44cb285954c83fed7c6ab58770a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.607Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a1aebfb1b356523137b180af: start","job_status":"start","queue_duration_s":0.768258,"scheduling_latency_s":0.768316}2410gitlab # [ 525.097357] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a1aebfb1b356523137b180af","created_at":"2026-09-04T07:47:42.574Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2f0a44cb285954c83fed7c6ab58770a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.607Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a1aebfb1b356523137b180af: done: 0.179944 sec","job_status":"done","queue_duration_s":0.768258,"scheduling_latency_s":0.768316,"redis_calls":9,"redis_duration_s":0.034832,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008711,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01047,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.015651,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051596,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.179944,"completed_at":"2026-09-04T07:47:43.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2411gitlab # [ 525.188556] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"87a2324add3e779ed58f590c","created_at":"2026-09-04T07:47:42.626Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699d160b3653a547c2e9f3b37fae658a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.643Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-87a2324add3e779ed58f590c: start","job_status":"start","queue_duration_s":0.925001,"scheduling_latency_s":0.925062}2412gitlab # [ 525.216160] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.675Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"87a2324add3e779ed58f590c","created_at":"2026-09-04T07:47:42.626Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"699d160b3653a547c2e9f3b37fae658a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.643Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-87a2324add3e779ed58f590c: done: 0.106569 sec","job_status":"done","queue_duration_s":0.925001,"scheduling_latency_s":0.925062,"redis_calls":11,"redis_duration_s":0.0055130000000000005,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000852,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002614,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00143806,"exclusive_lock_hold_duration_s":0.01976686,"duration_s":0.106569,"completed_at":"2026-09-04T07:47:43.675Z","load_balancing_strategy":"primary","db_duration_s":0.010883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2413gitlab # [ 525.287746] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:43.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e87a88e1560f2202a05d0b47","created_at":"2026-09-04T07:47:42.677Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b985f26549d2348cca611c0a0ba66fa","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.707Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e87a88e1560f2202a05d0b47: start","job_status":"start","queue_duration_s":0.971016,"scheduling_latency_s":0.971063}2414gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2415gitlab # [ 525.745468] gitaly[986]: time="2026-09-04T07:47:44.202Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6J9186800DG19QAKK63G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:14.198" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:44.200" grpc.time_ms=2.012 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2416gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.35 seconds)2417gitlab # [ 525.832739] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2562418gitlab # [ 526.454154] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:44.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"e87a88e1560f2202a05d0b47","created_at":"2026-09-04T07:47:42.677Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b985f26549d2348cca611c0a0ba66fa","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.707Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-e87a88e1560f2202a05d0b47: done: 1.231948 sec","job_status":"done","queue_duration_s":0.971016,"scheduling_latency_s":0.971063,"redis_calls":564,"redis_duration_s":0.251708,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001224,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.247512,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.071479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.231948,"completed_at":"2026-09-04T07:47:44.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2419gitlab # [ 526.457051] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:44.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"13f69cd11cc46d1f6f0c727b","created_at":"2026-09-04T07:47:42.741Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb213cdada93c1e31c77dd58be1eb7a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.779Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-13f69cd11cc46d1f6f0c727b: start","job_status":"start","queue_duration_s":2.136595,"scheduling_latency_s":2.136674}2420gitlab # [ 526.558019] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:44.955Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}2421gitlab # [ 526.578704] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:44.976Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"13f69cd11cc46d1f6f0c727b","created_at":"2026-09-04T07:47:42.741Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb213cdada93c1e31c77dd58be1eb7a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.779Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-13f69cd11cc46d1f6f0c727b: done: 0.060836 sec","job_status":"done","queue_duration_s":2.136595,"scheduling_latency_s":2.136674,"redis_calls":9,"redis_duration_s":0.004336,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00086,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060836,"completed_at":"2026-09-04T07:47:44.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2422gitlab # [ 526.625098] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:44.981Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ee70fa71809bddc0df9d7498","created_at":"2026-09-04T07:47:42.793Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"816653274fccc95ed78fc82730fc3664","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.806Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ee70fa71809bddc0df9d7498: start","job_status":"start","queue_duration_s":2.174374,"scheduling_latency_s":2.174416}2423gitlab # [ 526.639076] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ee70fa71809bddc0df9d7498","created_at":"2026-09-04T07:47:42.793Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"816653274fccc95ed78fc82730fc3664","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:42.806Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ee70fa71809bddc0df9d7498: done: 0.110794 sec","job_status":"done","queue_duration_s":2.174374,"scheduling_latency_s":2.174416,"redis_calls":9,"redis_duration_s":0.004831,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00101,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.110794,"completed_at":"2026-09-04T07:47:45.091Z","load_balancing_strategy":"primary","db_duration_s":0.042462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2424gitlab # [ 526.681347] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.096Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6fe341664a50c37e9a317f22","created_at":"2026-09-04T07:47:43.048Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fd455608160e60632af444aaa4ebc3f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.077Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6fe341664a50c37e9a317f22: start","job_status":"start","queue_duration_s":2.018675,"scheduling_latency_s":2.018716}2425gitlab # [ 526.728855] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.187Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6fe341664a50c37e9a317f22","created_at":"2026-09-04T07:47:43.048Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1fd455608160e60632af444aaa4ebc3f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.077Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6fe341664a50c37e9a317f22: done: 0.091243 sec","job_status":"done","queue_duration_s":2.018675,"scheduling_latency_s":2.018716,"redis_calls":9,"redis_duration_s":0.004543,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001089,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002589,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.091243,"completed_at":"2026-09-04T07:47:45.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2426gitlab # [ 526.776722] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"787cbb9fdca87e78693b021d","created_at":"2026-09-04T07:47:43.094Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"926e878cde28c4f2f0d6f6b84c5e5a2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.111Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-787cbb9fdca87e78693b021d: start","job_status":"start","queue_duration_s":2.079754,"scheduling_latency_s":2.079848}2427gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2428gitlab # [ 526.887654] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"787cbb9fdca87e78693b021d","created_at":"2026-09-04T07:47:43.094Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"926e878cde28c4f2f0d6f6b84c5e5a2d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.111Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-787cbb9fdca87e78693b021d: done: 0.155138 sec","job_status":"done","queue_duration_s":2.079754,"scheduling_latency_s":2.079848,"redis_calls":11,"redis_duration_s":0.005902,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001537,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002267,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00151042,"exclusive_lock_hold_duration_s":0.08164654,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.155138,"completed_at":"2026-09-04T07:47:45.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2429gitlab # [ 526.986508] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.350Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6b085aa8f16af3145880556d","created_at":"2026-09-04T07:47:43.119Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36a2a8f474cb8d3498ca89cc913f2a17","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.137Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6b085aa8f16af3145880556d: start","job_status":"start","queue_duration_s":2.21307,"scheduling_latency_s":2.213103}2430gitlab # [ 527.004169] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.426Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"6b085aa8f16af3145880556d","created_at":"2026-09-04T07:47:43.119Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36a2a8f474cb8d3498ca89cc913f2a17","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.137Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-6b085aa8f16af3145880556d: done: 0.076289 sec","job_status":"done","queue_duration_s":2.21307,"scheduling_latency_s":2.213103,"redis_calls":12,"redis_duration_s":0.005223,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000712,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0027,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02391414,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.076289,"completed_at":"2026-09-04T07:47:45.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009461,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2431gitlab # [ 527.048977] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.429Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"54346117778d9af1ec64d2fc","created_at":"2026-09-04T07:47:43.177Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.207Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-54346117778d9af1ec64d2fc: start","job_status":"start","queue_duration_s":2.222104,"scheduling_latency_s":2.222141}2432gitlab # [ 527.071895] gitaly[986]: time="2026-09-04T07:47:45.531Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6KK8E8GXQNE68BR60XN5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:15.528" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:45.529" grpc.time_ms=1.634 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2433gitlab # [ 527.143222] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2172434gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.32 seconds)2435gitlab # [ 527.249006] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.707Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"54346117778d9af1ec64d2fc","created_at":"2026-09-04T07:47:43.177Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.207Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-54346117778d9af1ec64d2fc: done: 0.27819 sec","job_status":"done","queue_duration_s":2.222104,"scheduling_latency_s":2.222141,"redis_calls":70,"redis_duration_s":0.030067,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.006462,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001256,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.021003,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.247148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.27819,"completed_at":"2026-09-04T07:47:45.707Z","load_balancing_strategy":"primary","db_duration_s":0.006268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2436gitlab # [ 527.344719] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.710Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4b812ab5efa8400bbf5c1b1a","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4b812ab5efa8400bbf5c1b1a: start","job_status":"start","queue_duration_s":2.426891,"scheduling_latency_s":2.426926}2437gitlab # [ 527.364535] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.743Z","message":"No existing merge request to be cleaned up."}2438gitlab # [ 527.366954] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.768Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4b812ab5efa8400bbf5c1b1a","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4b812ab5efa8400bbf5c1b1a: done: 0.057435 sec","job_status":"done","queue_duration_s":2.426891,"scheduling_latency_s":2.426926,"redis_calls":12,"redis_duration_s":0.004042,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000651,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001337,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057435,"completed_at":"2026-09-04T07:47:45.768Z","load_balancing_strategy":"primary","db_duration_s":0.010652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2439gitlab # [ 527.413234] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.770Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b44a7e56803070bc91c276c7","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b44a7e56803070bc91c276c7: start","job_status":"start","queue_duration_s":2.486461,"scheduling_latency_s":2.486526}2440gitlab # [ 527.425382] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.789Z","message":"No existing merge request to be cleaned up."}2441gitlab # [ 527.427530] nix-daemon[4349]: accepted connection from pid 5098, user nixbot2442gitlab # [ 527.428524] nix-daemon[4349]: accepted connection from pid 5059, user nixbot2443gitlab # [ 527.429490] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.805Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b44a7e56803070bc91c276c7","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b44a7e56803070bc91c276c7: done: 0.034999 sec","job_status":"done","queue_duration_s":2.486461,"scheduling_latency_s":2.486526,"redis_calls":10,"redis_duration_s":0.002758,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034999,"completed_at":"2026-09-04T07:47:45.805Z","load_balancing_strategy":"primary","db_duration_s":0.003233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2444gitlab # [ 527.468335] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.807Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e57bab734dca9a44dbcc728c","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e57bab734dca9a44dbcc728c: start","job_status":"start","queue_duration_s":2.523703,"scheduling_latency_s":2.523756}2445gitlab # [ 527.480241] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.829Z","message":"No existing merge request to be cleaned up."}2446gitlab # [ 527.481899] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.846Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e57bab734dca9a44dbcc728c","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e57bab734dca9a44dbcc728c: done: 0.038897 sec","job_status":"done","queue_duration_s":2.523703,"scheduling_latency_s":2.523756,"redis_calls":10,"redis_duration_s":0.003124,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038897,"completed_at":"2026-09-04T07:47:45.846Z","load_balancing_strategy":"primary","db_duration_s":0.003818,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2447gitlab # [ 527.520756] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.849Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b07a927d898692be26edefdb","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b07a927d898692be26edefdb: start","job_status":"start","queue_duration_s":2.565262,"scheduling_latency_s":2.565299}2448gitlab # [ 527.534239] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.873Z","message":"No existing merge request to be cleaned up."}2449gitlab # [ 527.536073] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.891Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b07a927d898692be26edefdb","created_at":"2026-09-04T07:47:43.209Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-84ca1529ace743b9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3d8a4bfd7d81ace82c5bec9b03c6d3cd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.283Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b07a927d898692be26edefdb: done: 0.042113 sec","job_status":"done","queue_duration_s":2.565262,"scheduling_latency_s":2.565299,"redis_calls":10,"redis_duration_s":0.004274,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002573,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042113,"completed_at":"2026-09-04T07:47:45.891Z","load_balancing_strategy":"primary","db_duration_s":0.003293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2450gitlab # [ 527.574606] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"97018c7116282458e20a286a","created_at":"2026-09-04T07:47:43.254Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f7ee3e95f47b2f1c18040f28039969","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.287Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-97018c7116282458e20a286a: start","job_status":"start","queue_duration_s":2.606288,"scheduling_latency_s":2.606357}2451gitlab # [ 527.589326] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.936Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"97018c7116282458e20a286a","created_at":"2026-09-04T07:47:43.254Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f7ee3e95f47b2f1c18040f28039969","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.287Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-97018c7116282458e20a286a: done: 0.042072 sec","job_status":"done","queue_duration_s":2.606288,"scheduling_latency_s":2.606357,"redis_calls":9,"redis_duration_s":0.00492,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000814,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042072,"completed_at":"2026-09-04T07:47:45.936Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2452gitlab # [ 527.631539] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:45.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e963af32423799feefa0ca6e","created_at":"2026-09-04T07:47:43.352Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f438402b5a4a6f9abea7b3899bf2f54d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.372Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e963af32423799feefa0ca6e: start","job_status":"start","queue_duration_s":2.566325,"scheduling_latency_s":2.566379}2453gitlab # [ 527.956558] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e963af32423799feefa0ca6e","created_at":"2026-09-04T07:47:43.352Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f438402b5a4a6f9abea7b3899bf2f54d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.372Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e963af32423799feefa0ca6e: done: 0.476512 sec","job_status":"done","queue_duration_s":2.566325,"scheduling_latency_s":2.566379,"redis_calls":13,"redis_duration_s":0.005255,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001775,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.099,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.347444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00081472,"exclusive_lock_hold_duration_s":0.4343439,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.476512,"completed_at":"2026-09-04T07:47:46.415Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.144035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2454gitlab # [ 528.056317] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ffeb424737d8d52d00f9129b","created_at":"2026-09-04T07:47:43.402Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c587efbd39230e483a3d84be1e3e79da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:47:43.415Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ffeb424737d8d52d00f9129b: start","job_status":"start","queue_duration_s":3.002612,"scheduling_latency_s":3.002643}2455gitlab # [ 528.072841] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.440Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}2456gitlab # [ 528.076976] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ffeb424737d8d52d00f9129b","created_at":"2026-09-04T07:47:43.402Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c587efbd39230e483a3d84be1e3e79da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:47:43.415Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ffeb424737d8d52d00f9129b: done: 0.037177 sec","job_status":"done","queue_duration_s":3.002612,"scheduling_latency_s":3.002643,"redis_calls":9,"redis_duration_s":0.003257,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000744,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0007,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037177,"completed_at":"2026-09-04T07:47:46.455Z","load_balancing_strategy":"primary","db_duration_s":0.001521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2457gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2458gitlab # [ 528.119810] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e5764aac2a1b41913c43a52b","created_at":"2026-09-04T07:47:43.444Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd8ab3b271ab29a55b387ccde593af55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.474Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e5764aac2a1b41913c43a52b: start","job_status":"start","queue_duration_s":2.983196,"scheduling_latency_s":2.983223}2459gitlab # [ 528.163665] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e5764aac2a1b41913c43a52b","created_at":"2026-09-04T07:47:43.444Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fd8ab3b271ab29a55b387ccde593af55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.474Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e5764aac2a1b41913c43a52b: done: 0.087571 sec","job_status":"done","queue_duration_s":2.983196,"scheduling_latency_s":2.983223,"redis_calls":11,"redis_duration_s":0.004108,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000968,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001606,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009969,"exclusive_lock_hold_duration_s":0.04835416,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.087571,"completed_at":"2026-09-04T07:47:46.545Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2460gitlab # [ 528.247028] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.548Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"286450ef16b9c5b8b27b2dfb","created_at":"2026-09-04T07:47:43.496Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c4b507aa968c22b7a8824b69f69dc61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.521Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-286450ef16b9c5b8b27b2dfb: start","job_status":"start","queue_duration_s":3.027655,"scheduling_latency_s":3.027685}2461gitlab # [ 528.263634] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.572Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}2462gitlab # [ 528.267762] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"286450ef16b9c5b8b27b2dfb","created_at":"2026-09-04T07:47:43.496Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c4b507aa968c22b7a8824b69f69dc61","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.521Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-286450ef16b9c5b8b27b2dfb: done: 0.036753 sec","job_status":"done","queue_duration_s":3.027655,"scheduling_latency_s":3.027685,"redis_calls":9,"redis_duration_s":0.00407,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000879,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036753,"completed_at":"2026-09-04T07:47:46.585Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2463gitlab # [ 528.310443] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.587Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d8c082058422e84c6fcee71e","created_at":"2026-09-04T07:47:43.544Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95a377be95c1af5dc65e65761972c223","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.567Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d8c082058422e84c6fcee71e: start","job_status":"start","queue_duration_s":3.020393,"scheduling_latency_s":3.020443}2464gitlab # [ 528.324651] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"d8c082058422e84c6fcee71e","created_at":"2026-09-04T07:47:43.544Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-13626f136d7d4079","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95a377be95c1af5dc65e65761972c223","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:43.567Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-d8c082058422e84c6fcee71e: done: 0.041997 sec","job_status":"done","queue_duration_s":3.020393,"scheduling_latency_s":3.020443,"redis_calls":11,"redis_duration_s":0.003299,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000667,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001362,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00088508,"exclusive_lock_hold_duration_s":0.00460722,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.041997,"completed_at":"2026-09-04T07:47:46.629Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2465gitlab # [ 528.368254] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99ccafb979fe8a9a3c312fb2","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99ccafb979fe8a9a3c312fb2: start","job_status":"start","queue_duration_s":0.94332,"scheduling_latency_s":0.943348}2466gitlab # [ 528.380534] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99ccafb979fe8a9a3c312fb2","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99ccafb979fe8a9a3c312fb2: done: 0.046453 sec","job_status":"done","queue_duration_s":0.94332,"scheduling_latency_s":0.943348,"redis_calls":15,"redis_duration_s":0.00484,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00292,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046453,"completed_at":"2026-09-04T07:47:46.678Z","load_balancing_strategy":"primary","db_duration_s":0.000998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2467gitlab # [ 528.420883] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c03d892af367533db8b026aa","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c03d892af367533db8b026aa: start","job_status":"start","queue_duration_s":0.991235,"scheduling_latency_s":0.991273}2468gitlab # [ 528.433102] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c03d892af367533db8b026aa","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c03d892af367533db8b026aa: done: 0.032879 sec","job_status":"done","queue_duration_s":0.991235,"scheduling_latency_s":0.991273,"redis_calls":13,"redis_duration_s":0.004994,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001783,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032879,"completed_at":"2026-09-04T07:47:46.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2469gitlab # [ 528.473301] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18c01e54c2f0409900c60349","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18c01e54c2f0409900c60349: start","job_status":"start","queue_duration_s":1.027548,"scheduling_latency_s":1.027572}2470gitlab # [ 528.486087] gitaly[986]: time="2026-09-04T07:47:46.857Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6MWMRXA02DT81BCRPPSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:16.855" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:46.856" grpc.time_ms=1.057 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2471gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.34 seconds)2472gitlab # [ 528.498744] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2312473gitlab # [ 528.501310] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18c01e54c2f0409900c60349","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18c01e54c2f0409900c60349: done: 0.03912 sec","job_status":"done","queue_duration_s":1.027548,"scheduling_latency_s":1.027572,"redis_calls":13,"redis_duration_s":0.009325,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006334,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03912,"completed_at":"2026-09-04T07:47:46.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2474gitlab # [ 528.539668] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dae755fdcd32d5cff322ba9","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dae755fdcd32d5cff322ba9: start","job_status":"start","queue_duration_s":1.069177,"scheduling_latency_s":1.069204}2475gitlab # [ 528.552065] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dae755fdcd32d5cff322ba9","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dae755fdcd32d5cff322ba9: done: 0.036398 sec","job_status":"done","queue_duration_s":1.069177,"scheduling_latency_s":1.069204,"redis_calls":13,"redis_duration_s":0.005693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036398,"completed_at":"2026-09-04T07:47:46.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2476gitlab # [ 528.591737] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4457130a7bc75d27c85ffb58","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4457130a7bc75d27c85ffb58: start","job_status":"start","queue_duration_s":1.108209,"scheduling_latency_s":1.108239}2477gitlab # [ 528.604006] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4457130a7bc75d27c85ffb58","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4457130a7bc75d27c85ffb58: done: 0.034169 sec","job_status":"done","queue_duration_s":1.108209,"scheduling_latency_s":1.108239,"redis_calls":13,"redis_duration_s":0.005519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001798,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034169,"completed_at":"2026-09-04T07:47:46.832Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2478gitlab # [ 528.642383] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f51e322178e0c0e8dd94ca3","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f51e322178e0c0e8dd94ca3: start","job_status":"start","queue_duration_s":1.1448,"scheduling_latency_s":1.144825}2479gitlab # [ 528.654701] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f51e322178e0c0e8dd94ca3","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f51e322178e0c0e8dd94ca3: done: 0.031855 sec","job_status":"done","queue_duration_s":1.1448,"scheduling_latency_s":1.144825,"redis_calls":13,"redis_duration_s":0.005902,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001322,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00458,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031855,"completed_at":"2026-09-04T07:47:46.866Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2480gitlab # [ 528.693079] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89b1187e61c7d13693c864fa","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89b1187e61c7d13693c864fa: start","job_status":"start","queue_duration_s":1.178919,"scheduling_latency_s":1.178942}2481gitlab # [ 528.705355] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89b1187e61c7d13693c864fa","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89b1187e61c7d13693c864fa: done: 0.046244 sec","job_status":"done","queue_duration_s":1.178919,"scheduling_latency_s":1.178942,"redis_calls":13,"redis_duration_s":0.004342,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001659,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002683,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046244,"completed_at":"2026-09-04T07:47:46.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2482gitlab # [ 528.743894] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8275d49a76d18a176c41339b","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8275d49a76d18a176c41339b: start","job_status":"start","queue_duration_s":1.233356,"scheduling_latency_s":1.23342}2483gitlab # [ 528.756285] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8275d49a76d18a176c41339b","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8275d49a76d18a176c41339b: done: 0.059467 sec","job_status":"done","queue_duration_s":1.233356,"scheduling_latency_s":1.23342,"redis_calls":13,"redis_duration_s":0.006365000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004564,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.059467,"completed_at":"2026-09-04T07:47:46.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2484gitlab # [ 528.796103] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:46.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af44b57095d27b1acb841cb","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af44b57095d27b1acb841cb: start","job_status":"start","queue_duration_s":1.297956,"scheduling_latency_s":1.298007}2485gitlab # [ 528.808213] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.030Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af44b57095d27b1acb841cb","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af44b57095d27b1acb841cb: done: 0.042455 sec","job_status":"done","queue_duration_s":1.297956,"scheduling_latency_s":1.298007,"redis_calls":13,"redis_duration_s":0.005299,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001802,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042455,"completed_at":"2026-09-04T07:47:47.030Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2486gitlab # [ 528.846692] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c011ddb33edf04c4f3b48542","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c011ddb33edf04c4f3b48542: start","job_status":"start","queue_duration_s":1.343991,"scheduling_latency_s":1.344024}2487gitlab # [ 528.859030] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c011ddb33edf04c4f3b48542","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c011ddb33edf04c4f3b48542: done: 0.030512 sec","job_status":"done","queue_duration_s":1.343991,"scheduling_latency_s":1.344024,"redis_calls":13,"redis_duration_s":0.004656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030512,"completed_at":"2026-09-04T07:47:47.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2488gitlab # [ 528.897313] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77fc3b6628af0621eecbf7ec","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77fc3b6628af0621eecbf7ec: start","job_status":"start","queue_duration_s":1.377655,"scheduling_latency_s":1.377685}2489gitlab # [ 528.909560] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77fc3b6628af0621eecbf7ec","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77fc3b6628af0621eecbf7ec: done: 0.03478 sec","job_status":"done","queue_duration_s":1.377655,"scheduling_latency_s":1.377685,"redis_calls":13,"redis_duration_s":0.00506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03478,"completed_at":"2026-09-04T07:47:47.102Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2490gitlab # [ 528.948265] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2ff777e59558720a52135ad","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2ff777e59558720a52135ad: start","job_status":"start","queue_duration_s":1.415493,"scheduling_latency_s":1.415533}2491gitlab # [ 528.960474] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.135Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2ff777e59558720a52135ad","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2ff777e59558720a52135ad: done: 0.030425 sec","job_status":"done","queue_duration_s":1.415493,"scheduling_latency_s":1.415533,"redis_calls":13,"redis_duration_s":0.004424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001422,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030425,"completed_at":"2026-09-04T07:47:47.135Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2492gitlab # [ 529.000007] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"760d2186730a405f03d1dcc1","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-760d2186730a405f03d1dcc1: start","job_status":"start","queue_duration_s":1.44896,"scheduling_latency_s":1.448987}2493gitlab # [ 529.012185] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"760d2186730a405f03d1dcc1","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-760d2186730a405f03d1dcc1: done: 0.032663 sec","job_status":"done","queue_duration_s":1.44896,"scheduling_latency_s":1.448987,"redis_calls":13,"redis_duration_s":0.004435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002991,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032663,"completed_at":"2026-09-04T07:47:47.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2494gitlab # [ 529.050739] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.174Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11b10f1dce2792b420ef37ea","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11b10f1dce2792b420ef37ea: start","job_status":"start","queue_duration_s":1.484311,"scheduling_latency_s":1.48437}2495gitlab # [ 529.063069] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11b10f1dce2792b420ef37ea","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11b10f1dce2792b420ef37ea: done: 0.031509 sec","job_status":"done","queue_duration_s":1.484311,"scheduling_latency_s":1.48437,"redis_calls":13,"redis_duration_s":0.004695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031509,"completed_at":"2026-09-04T07:47:47.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2496gitlab # [ 529.101497] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdefbbf19073581e17efa782","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdefbbf19073581e17efa782: start","job_status":"start","queue_duration_s":1.517946,"scheduling_latency_s":1.51797}2497gitlab # [ 529.113680] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdefbbf19073581e17efa782","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdefbbf19073581e17efa782: done: 0.03167 sec","job_status":"done","queue_duration_s":1.517946,"scheduling_latency_s":1.51797,"redis_calls":13,"redis_duration_s":0.00496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03167,"completed_at":"2026-09-04T07:47:47.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2498gitlab # [ 529.152453] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7abec772100e1fed3abd468","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7abec772100e1fed3abd468: start","job_status":"start","queue_duration_s":1.552089,"scheduling_latency_s":1.552114}2499gitlab # [ 529.164620] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7abec772100e1fed3abd468","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7abec772100e1fed3abd468: done: 0.029424 sec","job_status":"done","queue_duration_s":1.552089,"scheduling_latency_s":1.552114,"redis_calls":13,"redis_duration_s":0.004673999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003475,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029424,"completed_at":"2026-09-04T07:47:47.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2500gitlab # [ 529.204229] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"061d07e69b9cc7c71f171cd7","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-061d07e69b9cc7c71f171cd7: start","job_status":"start","queue_duration_s":1.584407,"scheduling_latency_s":1.584429}2501gitlab # [ 529.216381] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"061d07e69b9cc7c71f171cd7","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-061d07e69b9cc7c71f171cd7: done: 0.030979 sec","job_status":"done","queue_duration_s":1.584407,"scheduling_latency_s":1.584429,"redis_calls":13,"redis_duration_s":0.00435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001343,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030979,"completed_at":"2026-09-04T07:47:47.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2502gitlab # [ 529.254955] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7744028eef500b89bed0fb93","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7744028eef500b89bed0fb93: start","job_status":"start","queue_duration_s":1.617917,"scheduling_latency_s":1.617948}2503gitlab # [ 529.267102] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7744028eef500b89bed0fb93","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7744028eef500b89bed0fb93: done: 0.029385 sec","job_status":"done","queue_duration_s":1.617917,"scheduling_latency_s":1.617948,"redis_calls":13,"redis_duration_s":0.004425999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029385,"completed_at":"2026-09-04T07:47:47.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2504gitlab # [ 529.305899] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a91cdc54adcf1a40698a9bb2","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a91cdc54adcf1a40698a9bb2: start","job_status":"start","queue_duration_s":1.650228,"scheduling_latency_s":1.650282}2505gitlab # [ 529.318153] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a91cdc54adcf1a40698a9bb2","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a91cdc54adcf1a40698a9bb2: done: 0.029313 sec","job_status":"done","queue_duration_s":1.650228,"scheduling_latency_s":1.650282,"redis_calls":13,"redis_duration_s":0.004269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029313,"completed_at":"2026-09-04T07:47:47.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2506gitlab # [ 529.356332] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab56b3d190422f6f8c2877d","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab56b3d190422f6f8c2877d: start","job_status":"start","queue_duration_s":1.682009,"scheduling_latency_s":1.682032}2507gitlab # [ 529.368826] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab56b3d190422f6f8c2877d","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab56b3d190422f6f8c2877d: done: 0.031455 sec","job_status":"done","queue_duration_s":1.682009,"scheduling_latency_s":1.682032,"redis_calls":13,"redis_duration_s":0.003881,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001399,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002482,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031455,"completed_at":"2026-09-04T07:47:47.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2508gitlab # [ 529.408662] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c73fa3c3385fd98b8a5d36a","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c73fa3c3385fd98b8a5d36a: start","job_status":"start","queue_duration_s":1.716613,"scheduling_latency_s":1.716653}2509gitlab # [ 529.420808] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c73fa3c3385fd98b8a5d36a","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c73fa3c3385fd98b8a5d36a: done: 0.062936 sec","job_status":"done","queue_duration_s":1.716613,"scheduling_latency_s":1.716653,"redis_calls":13,"redis_duration_s":0.006587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004556,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.062936,"completed_at":"2026-09-04T07:47:47.469Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2510gitlab # [ 529.461108] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98f64309926710894ce4fc5a","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98f64309926710894ce4fc5a: start","job_status":"start","queue_duration_s":1.787245,"scheduling_latency_s":1.787307}2511gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2512gitlab # [ 529.474549] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98f64309926710894ce4fc5a","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98f64309926710894ce4fc5a: done: 0.074899 sec","job_status":"done","queue_duration_s":1.787245,"scheduling_latency_s":1.787307,"redis_calls":13,"redis_duration_s":0.007463,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00492,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.074899,"completed_at":"2026-09-04T07:47:47.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2513gitlab # [ 529.513958] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a5118d58519268d4a4af8cf","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a5118d58519268d4a4af8cf: start","job_status":"start","queue_duration_s":1.867181,"scheduling_latency_s":1.867313}2514gitlab # [ 529.525867] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a5118d58519268d4a4af8cf","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a5118d58519268d4a4af8cf: done: 0.048289 sec","job_status":"done","queue_duration_s":1.867181,"scheduling_latency_s":1.867313,"redis_calls":13,"redis_duration_s":0.005285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001461,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003824,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.048289,"completed_at":"2026-09-04T07:47:47.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2515gitlab # [ 529.564983] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02113f840c07f8b5c623e84c","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02113f840c07f8b5c623e84c: start","job_status":"start","queue_duration_s":1.91815,"scheduling_latency_s":1.91818}2516gitlab # [ 529.577458] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02113f840c07f8b5c623e84c","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02113f840c07f8b5c623e84c: done: 0.032468 sec","job_status":"done","queue_duration_s":1.91815,"scheduling_latency_s":1.91818,"redis_calls":13,"redis_duration_s":0.00464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032468,"completed_at":"2026-09-04T07:47:47.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2517gitlab # [ 529.617437] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a2dd5ea3b9f1c80e85bacc","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a2dd5ea3b9f1c80e85bacc: start","job_status":"start","queue_duration_s":1.95286,"scheduling_latency_s":1.952895}2518gitlab # [ 529.629599] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05a2dd5ea3b9f1c80e85bacc","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05a2dd5ea3b9f1c80e85bacc: done: 0.028962 sec","job_status":"done","queue_duration_s":1.95286,"scheduling_latency_s":1.952895,"redis_calls":13,"redis_duration_s":0.004009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001128,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028962,"completed_at":"2026-09-04T07:47:47.671Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2519gitlab # [ 529.668731] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e7ff965927dd761a0af2fea","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e7ff965927dd761a0af2fea: start","job_status":"start","queue_duration_s":1.984773,"scheduling_latency_s":1.984797}2520gitlab # [ 529.681069] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e7ff965927dd761a0af2fea","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e7ff965927dd761a0af2fea: done: 0.027759 sec","job_status":"done","queue_duration_s":1.984773,"scheduling_latency_s":1.984797,"redis_calls":13,"redis_duration_s":0.00451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027759,"completed_at":"2026-09-04T07:47:47.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2521gitlab # [ 529.720614] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6dcf542cb35889af3a9ab8d","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6dcf542cb35889af3a9ab8d: start","job_status":"start","queue_duration_s":2.01456,"scheduling_latency_s":2.014579}2522gitlab # [ 529.733242] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6dcf542cb35889af3a9ab8d","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6dcf542cb35889af3a9ab8d: done: 0.027901 sec","job_status":"done","queue_duration_s":2.01456,"scheduling_latency_s":2.014579,"redis_calls":13,"redis_duration_s":0.004411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018467,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027901,"completed_at":"2026-09-04T07:47:47.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2523gitlab # [ 529.772501] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9f8192beb9bd953acca19b3","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9f8192beb9bd953acca19b3: start","job_status":"start","queue_duration_s":2.044728,"scheduling_latency_s":2.04477}2524gitlab # [ 529.785119] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9f8192beb9bd953acca19b3","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9f8192beb9bd953acca19b3: done: 0.028704 sec","job_status":"done","queue_duration_s":2.044728,"scheduling_latency_s":2.04477,"redis_calls":13,"redis_duration_s":0.004534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028704,"completed_at":"2026-09-04T07:47:47.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2525gitlab # [ 529.826036] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c14feda8ed15ac34e25c8f","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c14feda8ed15ac34e25c8f: start","job_status":"start","queue_duration_s":2.075686,"scheduling_latency_s":2.075708}2526gitlab # [ 529.839348] gitaly[986]: time="2026-09-04T07:47:48.208Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6P7HRC63Z09RJDBAVE3R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:18.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:48.206" grpc.time_ms=1.78 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2527gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.37 seconds)2528gitlab # [ 529.852519] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c14feda8ed15ac34e25c8f","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c14feda8ed15ac34e25c8f: done: 0.029442 sec","job_status":"done","queue_duration_s":2.075686,"scheduling_latency_s":2.075708,"redis_calls":13,"redis_duration_s":0.004238,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001351,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029442,"completed_at":"2026-09-04T07:47:47.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2529gitlab # [ 529.891210] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3960d93078511b77e4e9e5d","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3960d93078511b77e4e9e5d: start","job_status":"start","queue_duration_s":2.106964,"scheduling_latency_s":2.106985}2530gitlab # [ 529.904410] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2292531gitlab # [ 529.907073] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3960d93078511b77e4e9e5d","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3960d93078511b77e4e9e5d: done: 0.027646 sec","job_status":"done","queue_duration_s":2.106964,"scheduling_latency_s":2.106985,"redis_calls":13,"redis_duration_s":0.003879,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002625,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027646,"completed_at":"2026-09-04T07:47:47.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2532gitlab # [ 529.946502] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09f96c857afd491d11a80fea","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09f96c857afd491d11a80fea: start","job_status":"start","queue_duration_s":2.136934,"scheduling_latency_s":2.136954}2533gitlab # [ 529.959131] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09f96c857afd491d11a80fea","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09f96c857afd491d11a80fea: done: 0.026236 sec","job_status":"done","queue_duration_s":2.136934,"scheduling_latency_s":2.136954,"redis_calls":13,"redis_duration_s":0.004366,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002988,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026236,"completed_at":"2026-09-04T07:47:47.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2534gitlab # [ 529.998104] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b22c52da44d88f0989d46cef","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b22c52da44d88f0989d46cef: start","job_status":"start","queue_duration_s":2.165576,"scheduling_latency_s":2.16564}2535gitlab # [ 530.011645] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b22c52da44d88f0989d46cef","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b22c52da44d88f0989d46cef: done: 0.027874 sec","job_status":"done","queue_duration_s":2.165576,"scheduling_latency_s":2.16564,"redis_calls":13,"redis_duration_s":0.0043619999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001303,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027874,"completed_at":"2026-09-04T07:47:47.883Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2536gitlab # [ 530.051802] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e568f706b56066cb9bf00107","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e568f706b56066cb9bf00107: start","job_status":"start","queue_duration_s":2.195651,"scheduling_latency_s":2.195671}2537gitlab # [ 530.064443] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e568f706b56066cb9bf00107","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e568f706b56066cb9bf00107: done: 0.028866 sec","job_status":"done","queue_duration_s":2.195651,"scheduling_latency_s":2.195671,"redis_calls":13,"redis_duration_s":0.0052250000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028866,"completed_at":"2026-09-04T07:47:47.914Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2538gitlab # [ 530.103460] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936c46f21a16741bc7ca8cb2","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936c46f21a16741bc7ca8cb2: start","job_status":"start","queue_duration_s":2.226984,"scheduling_latency_s":2.227006}2539gitlab # [ 530.116110] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"936c46f21a16741bc7ca8cb2","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-936c46f21a16741bc7ca8cb2: done: 0.027484 sec","job_status":"done","queue_duration_s":2.226984,"scheduling_latency_s":2.227006,"redis_calls":13,"redis_duration_s":0.004505,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027484,"completed_at":"2026-09-04T07:47:47.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2540gitlab # [ 530.155284] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7988605cf702f6a8bd2ef17e","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7988605cf702f6a8bd2ef17e: start","job_status":"start","queue_duration_s":2.256685,"scheduling_latency_s":2.256728}2541gitlab # [ 530.168001] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7988605cf702f6a8bd2ef17e","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7988605cf702f6a8bd2ef17e: done: 0.027519 sec","job_status":"done","queue_duration_s":2.256685,"scheduling_latency_s":2.256728,"redis_calls":13,"redis_duration_s":0.0040820000000000006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027519,"completed_at":"2026-09-04T07:47:47.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2542gitlab # [ 530.206947] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:47.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"261e3fe6c0651b6b5c8f99b5","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-261e3fe6c0651b6b5c8f99b5: start","job_status":"start","queue_duration_s":2.286327,"scheduling_latency_s":2.286351}2543gitlab # [ 530.220739] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"261e3fe6c0651b6b5c8f99b5","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-261e3fe6c0651b6b5c8f99b5: done: 0.027681 sec","job_status":"done","queue_duration_s":2.286327,"scheduling_latency_s":2.286351,"redis_calls":13,"redis_duration_s":0.004256,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001396,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00286,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027681,"completed_at":"2026-09-04T07:47:48.003Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2544gitlab # [ 530.259909] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19aa8a93ad9b384772330860","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19aa8a93ad9b384772330860: start","job_status":"start","queue_duration_s":2.320254,"scheduling_latency_s":2.320278}2545gitlab # [ 530.272522] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19aa8a93ad9b384772330860","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19aa8a93ad9b384772330860: done: 0.036046 sec","job_status":"done","queue_duration_s":2.320254,"scheduling_latency_s":2.320278,"redis_calls":13,"redis_duration_s":0.0119,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009445,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036046,"completed_at":"2026-09-04T07:47:48.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2546gitlab # [ 530.311574] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d38ffdb94ebcabe8a94114f","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d38ffdb94ebcabe8a94114f: start","job_status":"start","queue_duration_s":2.358863,"scheduling_latency_s":2.358906}2547gitlab # [ 530.324182] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d38ffdb94ebcabe8a94114f","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d38ffdb94ebcabe8a94114f: done: 0.035087 sec","job_status":"done","queue_duration_s":2.358863,"scheduling_latency_s":2.358906,"redis_calls":13,"redis_duration_s":0.010151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008614,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035087,"completed_at":"2026-09-04T07:47:48.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2548gitlab # [ 530.363150] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba73dc207a3c9ab6ff8bab88","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba73dc207a3c9ab6ff8bab88: start","job_status":"start","queue_duration_s":2.398654,"scheduling_latency_s":2.398682}2549gitlab # [ 530.375404] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba73dc207a3c9ab6ff8bab88","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba73dc207a3c9ab6ff8bab88: done: 0.030013 sec","job_status":"done","queue_duration_s":2.398654,"scheduling_latency_s":2.398682,"redis_calls":13,"redis_duration_s":0.0038009999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030013,"completed_at":"2026-09-04T07:47:48.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2550gitlab # [ 530.414836] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"411758d46ce466efcf23636c","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-411758d46ce466efcf23636c: start","job_status":"start","queue_duration_s":2.431006,"scheduling_latency_s":2.431031}2551gitlab # [ 530.428465] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"411758d46ce466efcf23636c","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-411758d46ce466efcf23636c: done: 0.032168 sec","job_status":"done","queue_duration_s":2.431006,"scheduling_latency_s":2.431031,"redis_calls":13,"redis_duration_s":0.0031660000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032168,"completed_at":"2026-09-04T07:47:48.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2552gitlab # [ 530.467409] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fb47fc26857b073624ec515","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fb47fc26857b073624ec515: start","job_status":"start","queue_duration_s":2.46519,"scheduling_latency_s":2.465213}2553gitlab # [ 530.480457] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fb47fc26857b073624ec515","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fb47fc26857b073624ec515: done: 0.027556 sec","job_status":"done","queue_duration_s":2.46519,"scheduling_latency_s":2.465213,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001537,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027556,"completed_at":"2026-09-04T07:47:48.182Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2554gitlab # [ 530.519547] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed36cf722ba9c58b80dc07fd","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed36cf722ba9c58b80dc07fd: start","job_status":"start","queue_duration_s":2.495054,"scheduling_latency_s":2.495076}2555gitlab # [ 530.532141] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed36cf722ba9c58b80dc07fd","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed36cf722ba9c58b80dc07fd: done: 0.027169 sec","job_status":"done","queue_duration_s":2.495054,"scheduling_latency_s":2.495076,"redis_calls":13,"redis_duration_s":0.00433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0016,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00273,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027169,"completed_at":"2026-09-04T07:47:48.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2556gitlab # [ 530.570756] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7959f39c0725db73ded2f3b1","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7959f39c0725db73ded2f3b1: start","job_status":"start","queue_duration_s":2.529204,"scheduling_latency_s":2.529232}2557gitlab # [ 530.583317] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7959f39c0725db73ded2f3b1","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7959f39c0725db73ded2f3b1: done: 0.03125 sec","job_status":"done","queue_duration_s":2.529204,"scheduling_latency_s":2.529232,"redis_calls":13,"redis_duration_s":0.00343,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00216,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03125,"completed_at":"2026-09-04T07:47:48.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2558gitlab # [ 530.622663] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9738d17caab357e0a824b157","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9738d17caab357e0a824b157: start","job_status":"start","queue_duration_s":2.562884,"scheduling_latency_s":2.562935}2559gitlab # [ 530.636649] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9738d17caab357e0a824b157","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9738d17caab357e0a824b157: done: 0.032619 sec","job_status":"done","queue_duration_s":2.562884,"scheduling_latency_s":2.562935,"redis_calls":13,"redis_duration_s":0.005376000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032619,"completed_at":"2026-09-04T07:47:48.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2560gitlab # [ 530.675741] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a76c35a1e5b37902b98a635e","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a76c35a1e5b37902b98a635e: start","job_status":"start","queue_duration_s":2.598378,"scheduling_latency_s":2.598428}2561gitlab # [ 530.688463] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a76c35a1e5b37902b98a635e","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a76c35a1e5b37902b98a635e: done: 0.027845 sec","job_status":"done","queue_duration_s":2.598378,"scheduling_latency_s":2.598428,"redis_calls":13,"redis_duration_s":0.004048,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027845,"completed_at":"2026-09-04T07:47:48.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2562gitlab # [ 530.728070] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4202f736c84eade4f23cf243","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4202f736c84eade4f23cf243: start","job_status":"start","queue_duration_s":2.628756,"scheduling_latency_s":2.628779}2563gitlab # [ 530.740880] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4202f736c84eade4f23cf243","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4202f736c84eade4f23cf243: done: 0.028015 sec","job_status":"done","queue_duration_s":2.628756,"scheduling_latency_s":2.628779,"redis_calls":13,"redis_duration_s":0.004044,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002654,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028015,"completed_at":"2026-09-04T07:47:48.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2564gitlab # [ 530.780129] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"669cbb5718f3d75c08e4de68","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-669cbb5718f3d75c08e4de68: start","job_status":"start","queue_duration_s":2.659274,"scheduling_latency_s":2.659298}2565gitlab # [ 530.792451] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"669cbb5718f3d75c08e4de68","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-669cbb5718f3d75c08e4de68: done: 0.02884 sec","job_status":"done","queue_duration_s":2.659274,"scheduling_latency_s":2.659298,"redis_calls":13,"redis_duration_s":0.0050089999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001464,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003545,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02884,"completed_at":"2026-09-04T07:47:48.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2566gitlab # [ 530.831453] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6995e43aeaf34174cd5cb902","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6995e43aeaf34174cd5cb902: start","job_status":"start","queue_duration_s":2.690682,"scheduling_latency_s":2.69073}2567gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2568gitlab # [ 530.845237] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6995e43aeaf34174cd5cb902","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6995e43aeaf34174cd5cb902: done: 0.027091 sec","job_status":"done","queue_duration_s":2.690682,"scheduling_latency_s":2.69073,"redis_calls":13,"redis_duration_s":0.003824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001318,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002506,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027091,"completed_at":"2026-09-04T07:47:48.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2569gitlab # [ 530.883623] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25cd91b44aaae5fef80c3c8c","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25cd91b44aaae5fef80c3c8c: start","job_status":"start","queue_duration_s":2.720104,"scheduling_latency_s":2.720125}2570gitlab # [ 530.895400] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25cd91b44aaae5fef80c3c8c","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25cd91b44aaae5fef80c3c8c: done: 0.027973 sec","job_status":"done","queue_duration_s":2.720104,"scheduling_latency_s":2.720125,"redis_calls":13,"redis_duration_s":0.0037099999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002441,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027973,"completed_at":"2026-09-04T07:47:48.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2571gitlab # [ 530.934130] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517e2e108cb38ac8dba52f55","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517e2e108cb38ac8dba52f55: start","job_status":"start","queue_duration_s":2.750268,"scheduling_latency_s":2.75029}2572gitlab # [ 530.946696] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:48.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517e2e108cb38ac8dba52f55","created_at":"2026-09-04T07:47:45.499Z","trace_propagation_headers":{"sentry-trace":"61a9597ff36c436b9df1f2e3c0052834-79f4a89eea0a4ad9","baggage":"sentry-trace_id=61a9597ff36c436b9df1f2e3c0052834,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ba3592cb4e32a3762c88ce522e47e6a7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:47:45.689Z","job_size_bytes":2,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517e2e108cb38ac8dba52f55: done: 0.080466 sec","job_status":"done","queue_duration_s":2.750268,"scheduling_latency_s":2.75029,"redis_calls":13,"redis_duration_s":0.0077859999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.080466,"completed_at":"2026-09-04T07:47:48.520Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2573gitlab # [ 531.158957] gitaly[986]: time="2026-09-04T07:47:49.617Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6QJ27TTJ08FW52NB5K35 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:19.613" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:49.614" grpc.time_ms=2.138 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2574gitlab # [ 531.265119] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2802575gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.41 seconds)2576gitlab # [ 531.642387] nix-daemon[4349]: accepted connection from pid 5059, user nixbot2577gitlab # [ 532.046941] gitaly[986]: time="2026-09-04T07:47:50.506Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:20.002" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:50.503" grpc.time_ms=2.591 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2578gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2579gitlab # [ 532.255595] gitaly[986]: time="2026-09-04T07:47:50.713Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:00.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:50.685" grpc.time_ms=27.878 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2580gitlab # [ 532.397402] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:50.853Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b2c5280cc32ed171b684a5fb","created_at":"2026-09-04T07:47:50.839Z","trace_propagation_headers":{"sentry-trace":"c4c76a4ecb4246459058405a3b4b14d5-61cc76ac2ae1463f","baggage":"sentry-trace_id=c4c76a4ecb4246459058405a3b4b14d5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6RBA1645295K23SV504R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.849Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b2c5280cc32ed171b684a5fb: start","job_status":"start","queue_duration_s":0.003618,"scheduling_latency_s":0.003763}2581gitlab # [ 532.458722] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 6652582gitlab # [ 532.466940] nixbot[4118]: {"ts": "2026-09-04T07:47:50.925Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c \"HTTP/1.1 201 Created\""}2583gitlab # [ 532.488626] gitaly[986]: time="2026-09-04T07:47:50.948Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RWVWHRHZ2MXQDN706B4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:20.846" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:50.946" grpc.time_ms=1.257 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2584gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.38 seconds)2585gitlab # [ 532.642803] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 2892586gitlab # [ 532.877270] gitaly[986]: time="2026-09-04T07:47:51.336Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6S11ARASNY5W4P7TYD9G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:21.332" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.333" grpc.time_ms=2.681 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2587gitlab # [ 533.046804] gitaly[986]: time="2026-09-04T07:47:51.506Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6S11ARASNY5W4P7TYD9G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:01.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.475" grpc.time_ms=30.307 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2588gitlab # [ 533.162578] gitaly[986]: time="2026-09-04T07:47:51.622Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:51.620" grpc.time_ms=1.135 pid=986 span.kind=server system=grpc2589gitlab # [ 533.244121] gitaly[986]: time="2026-09-04T07:47:51.703Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:51.699" grpc.time_ms=1.896 pid=986 span.kind=server system=grpc2590gitlab # [ 533.267351] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 7632591gitlab # [ 533.273024] nixbot[4118]: {"ts": "2026-09-04T07:47:51.710Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c \"HTTP/1.1 201 Created\""}2592gitlab # [ 533.311819] gitaly[986]: time="2026-09-04T07:47:51.770Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:47:51.768" grpc.time_ms=1.777 pid=986 span.kind=server system=grpc2593gitlab # [ 533.329488] gitaly[986]: time="2026-09-04T07:47:51.788Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:21.534" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.535" operations="[repack_refs]" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2594gitlab # [ 533.345465] gitaly[986]: time="2026-09-04T07:47:51.797Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R diskcache=06582724-1d19-47b7-b4e8-1f63360b97ee grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:21.534" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.535" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2595gitlab # [ 533.359227] gitaly[986]: time="2026-09-04T07:47:51.798Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=243 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7436 command.oublock=0 command.real_time_ms=248 command.spawn_token_fork_ms=2 command.system_time_ms=139 command.user_time_ms=104 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:21.534" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.535" grpc.time_ms=261.939 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2596gitlab # [ 533.375337] gitaly[986]: time="2026-09-04T07:47:51.800Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:21.534" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.535" pid=986 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-04 07:45:43.84858352 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2597gitlab # [ 533.395019] gitaly[986]: time="2026-09-04T07:47:51.854Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:21.534" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.535" pid=986 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2598gitlab # [ 533.419441] gitaly[986]: time="2026-09-04T07:47:51.855Z" level=info msg="optimized repository" clean_stale_data_time=53.12622ms clean_work_trees_time="230.28µs" commit_graph_time="1µs" correlation_id=01M1NP6RBA1645295K23SV504R gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.8µs" pid=986 prune_time="2.1µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="5.28µs" storage_name=default system=housekeeping total_time=53.54348ms2599gitlab # [ 533.429478] gitaly[986]: time="2026-09-04T07:47:51.855Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-04T07:48:21.534" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:51.535" pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2600gitlab # [ 533.444297] gitaly[986]: time="2026-09-04T07:47:51.903Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6ST08M1CDZN3EHDADKFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:21.401" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.902" grpc.time_ms=0.956 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2601gitlab # [ 533.540285] gitaly[986]: time="2026-09-04T07:47:51.999Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-04T07:48:21.895" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:51.997" grpc.time_ms=2.446 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2602gitlab # [ 533.563899] gitaly[986]: time="2026-09-04T07:47:52.023Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1NP6ST08M1CDZN3EHDADKFM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:48:02.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:47:52.009" grpc.time_ms=13.941 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2603gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses2604gitlab # [ 533.664061] gitaly[986]: time="2026-09-04T07:47:52.122Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6RBA1645295K23SV504R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:22.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:52.117" grpc.time_ms=1.449 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2605gitlab # [ 533.685050] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3882606gitlab # [ 533.689097] nixbot[4118]: {"ts": "2026-09-04T07:47:52.137Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/6aa9b7693c850f5465f140d3cfcd1e5884232c1c \"HTTP/1.1 201 Created\""}2607gitlab # [ 533.698680] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:52.157Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"9bb00ac617a475da690ecb48","created_at":"2026-09-04T07:47:52.152Z","trace_propagation_headers":{"sentry-trace":"c4c76a4ecb4246459058405a3b4b14d5-0eaa3fbc5f364314","baggage":"sentry-trace_id=c4c76a4ecb4246459058405a3b4b14d5,sentry-release=Unknown"},"correlation_id":"01M1NP6RBA1645295K23SV504R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"b2c5280cc32ed171b684a5fb","job_size_bytes":3,"pid":4052,"job_status":"deduplicated","message":"PipelineProcessWorker JID-9bb00ac617a475da690ecb48: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2608gitlab # [ 533.720127] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:52.161Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b2c5280cc32ed171b684a5fb","created_at":"2026-09-04T07:47:50.839Z","trace_propagation_headers":{"sentry-trace":"c4c76a4ecb4246459058405a3b4b14d5-61cc76ac2ae1463f","baggage":"sentry-trace_id=c4c76a4ecb4246459058405a3b4b14d5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6RBA1645295K23SV504R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.849Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":4052,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b2c5280cc32ed171b684a5fb: rescheduled"}2609gitlab # [ 533.740575] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:52.175Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b2c5280cc32ed171b684a5fb","created_at":"2026-09-04T07:47:50.839Z","trace_propagation_headers":{"sentry-trace":"c4c76a4ecb4246459058405a3b4b14d5-61cc76ac2ae1463f","baggage":"sentry-trace_id=c4c76a4ecb4246459058405a3b4b14d5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1NP6RBA1645295K23SV504R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:50.849Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b2c5280cc32ed171b684a5fb: done: 1.323145 sec","job_status":"done","queue_duration_s":0.003618,"scheduling_latency_s":0.003763,"gitaly_calls":3,"gitaly_duration_s":0.291527,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.05803,"redis_read_bytes":239,"redis_write_bytes":21787,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004317,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00439,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.015715,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14472,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.014905,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000963,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.005568,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.007855,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.405,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.026,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.036,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.121,"db_ci_duration_s":0.284,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.565553,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":1.12989792,"duration_s":1.323145,"completed_at":"2026-09-04T07:47:52.175Z","load_balancing_strategy":"primary","db_duration_s":0.414892,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2610gitlab # [ 533.795758] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:52.178Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8cdbfa37701d68acc71a0030","created_at":"2026-09-04T07:47:51.492Z","trace_propagation_headers":{"sentry-trace":"c4c76a4ecb4246459058405a3b4b14d5-0eaa3fbc5f364314","baggage":"sentry-trace_id=c4c76a4ecb4246459058405a3b4b14d5,sentry-release=Unknown"},"correlation_id":"01M1NP6RBA1645295K23SV504R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:51.504Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8cdbfa37701d68acc71a0030: start","job_status":"start","queue_duration_s":0.673955,"scheduling_latency_s":0.673989}2611gitlab # [ 533.829699] gitaly[986]: time="2026-09-04T07:47:52.289Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NP6T7VJ3QX629M2BHXAYSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:48:22.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:47:52.287" grpc.time_ms=1.744 pid=986 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2612gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses, in 0.25 seconds)2613(finished: subtest: eval and build post commit statuses, in 12.06 seconds)2614(finished: run the VM test script, in 630.39 seconds)2615gitlab # [ 533.874251] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:52.332Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8cdbfa37701d68acc71a0030","created_at":"2026-09-04T07:47:51.492Z","trace_propagation_headers":{"sentry-trace":"c4c76a4ecb4246459058405a3b4b14d5-0eaa3fbc5f364314","baggage":"sentry-trace_id=c4c76a4ecb4246459058405a3b4b14d5,sentry-release=Unknown"},"correlation_id":"01M1NP6RBA1645295K23SV504R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:51.504Z","job_size_bytes":23,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8cdbfa37701d68acc71a0030: done: 0.153391 sec","job_status":"done","queue_duration_s":0.673955,"scheduling_latency_s":0.673989,"redis_calls":7,"redis_duration_s":0.006698000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003122,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003576,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.153391,"completed_at":"2026-09-04T07:47:52.332Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04157,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2616gitlab # [ 533.919503] sidekiq-cluster[4052]: {"severity":"INFO","time":"2026-09-04T07:47:52.361Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"804d6393460455dd3f5af5e5","created_at":"2026-09-04T07:47:51.819Z","trace_propagation_headers":{"sentry-trace":"c4c76a4ecb4246459058405a3b4b14d5-0eaa3fbc5f364314","baggage":"sentry-trace_id=c4c76a4ecb4246459058405a3b4b14d5,sentry-release=Unknown"},"correlation_id":"01M1NP6RBA1645295K23SV504R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-04T07:47:51.825Z","job_size_bytes":3,"pid":4052,"sidekiq_tid":"m948","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-804d6393460455dd3f5af5e5: start","job_status":"start","queue_duration_s":0.53545,"scheduling_latency_s":0.535525}2617gitlab # [ 533.939679] gitlab-workhorse[871]: gitlab 2001:db8:1::1 - - [2026/09/04:07:47:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/6aa9b7693c850f5465f140d3cfcd1e5884232c1c/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1672618test script finished in 630.44s2619cleanup2620kill QemuMachine (pid 46)2621gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2622(finished: cleanup, in 2.17 seconds)2623additionally exposed symbols:2624 gitlab,2625 vlan1,2626 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2627[]2628[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T07:45:53.219Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2629[]2630[]2631[]2632[]2633[]2634[]2635[]2636[]2637[]2638[]2639[]2640[]2641[]2642[]2643[]2644[]2645[]2646[]2647[]2648[]2649[]2650[]2651[]2652[]2653[]2654[]2655[]2656[]2657[]2658[]2659[]2660[]2661[]2662[]2663[]2664[]2665[]2666[]2667[]2668[]2669[]2670[]2671[]2672[]2673[]2674[]2675[]2676[]2677[]2678[]2679[]2680[]2681[]2682[]2683[]2684[]2685[]2686[]2687[]2688[]2689[]2690[]2691[]2692[]2693[]2694[]2695[]2696[]2697[]2698[]2699[]2700[]2701[]2702[]2703[]2704[]2705[]2706[]2707[]2708[]2709[]2710[]2711[]2712[]2713[]2714[]2715[]2716[]2717[]2718[]2719[]2720[]2721[]2722[]2723[]2724[]2725[]2726[]2727[]2728[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-04T07:47:39.819243Z', 'started_at': '2026-09-04T07:47:40.165040Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2729[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2730[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2731[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2732[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2733[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2734[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2735[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2736[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2737[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': '2026-09-04T07:47:50.806Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2738[{'id': 5, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-04T07:47:40.120Z', 'started_at': None, 'finished_at': '2026-09-04T07:47:50.806Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '6aa9b7693c850f5465f140d3cfcd1e5884232c1c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-04T07:47:51.611Z', 'started_at': None, 'finished_at': '2026-09-04T07:47:52.078Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]